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Introduction 

A classical problem in Hamiltonian dynamical systems concerns, since the researches of 
Poincare, the existence of periodic orbits in the vicinity of invariant submanifolds. 

Poincare wrote: "...void un fait que je n'ai pu demontrer rigoureusement, mais qui 
me parait pourtant tres vraisemblable. Etant donnees des equations de la forme definie 
dans le n. 13^ et une solution paxticuliere quelconque de ces equations, one peut toujours 
trouver une solution periodique (dont la periode peut, il est vrai, etre tres longue), telle 
que la difference entre les deux solutions soit aussi petite qu'on le veut, pendant un temps 
aussi long qu'on le veut." ([P], Tome 1, ch. Ill, a. 36). 

This conjecture was often quoted by Birkhoff as a main motivation for his works. In 
the thirties, Birkhoff and Lewis [B]-[BL]-[L] estabhshed the existence of infinitely many 
periodic solutions in a neighborhood of an elliptic equilibrium whose linear frequencies 
are sufficiently non-resonant. This Theorem also requires a non- degeneracy - "twist"- con- 
dition, involving finitely many Taylor coefficients of the Hamiltonian at the equilibrium, 
and implying the system to be genuinely non-linear. In addition, if the Hamiltonian is 
sufficiently smooth, KAM theory ensures, in a neighborhood of the equihbrium small 
enough, the existence of invariant Lagrangian tori filling up a set of positive Lebesgue 
measure, see [Po]. Furthermore, close to any KAM torus, it has been proved in [CZ] the 
existence of infinitely many others periodic orbits with larger and larger minimal period 
accumulating to the torus itself (as a consequence, the closure of the periodic orbits 
has positive Lebesgue measure). The result of [CZ] is proved considering the normal 

^The Hamilton's equations. 
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form Hamiltonian which describes the dynamics near each torus, checking the "twist 
condition", and, then, applying the Birkhoff- Lewis type Theorem of [Mo]. 

Actually, Birkhoff and Lewis established also the existence of infinitely many periodic 
solutions close to a non-constant periodic elliptic solution. 

The question of the existence of periodic orbits with larger and larger minimal period 
clustering to elliptic lower dimensional invariant tori (of dimension greater than one) has 
not been yet investigated. An invariant torus is called elliptic, or linearly stable, if the 
linearized system along the torus, possesses purely imaginary eigenvalues. 

A main motivation for studying such problem is Celestial Mechanics, which, in- 
deed, inspired the whole development of KAM theory (Arnold [A] devoted one of the 
fundamental papers of this theory to the planar n-body problem). 

Consider, in particular, the non-planar planetary three body problem, namely one 
"star" and two "planets" interacting through a Newtonian gravitational field in the 
three dimensional space. The masses of the planets are regarded as small parameters. 
According to Poincare and Delaunay this system is described by a nearly-integrable 
Hamiltonian on a eight dimensional phase space, equipped with real-analytic action- 
angle variables. Such system turns out to be properly degenerate, i.e. the intcgrable limit 
(in which the three body-problem is described by two decoupled and integrable two-body 
systems) depends only on two action variables. Hence, in the integrable limit all bounded 
motions lie on two-dimensional invariant tori supporting periodic or quasi-periodic mo- 
tions according the ratio between the two frequencies (related, by Kepler's law, to the 
major semi-axis of the two limiting Keplerian ellipes) is a rational or irrational number. 
Furthemore, in the small eccentricity-inclination regime (of astronomical interest) these 
unperturbed two-tori are elliptic: the spatial planetary three body-problem calls for a 
perturbation theory for continuing elliptic lower- dimensional tori. 

In the last years, an exhaustive perturbation theory for elliptic tori has indeed been 
developed by many authors, see [M], [E], [W], [K], [Pol], [Po2], [Bo] and [XJ]. The per- 
sistence of elliptic tori is ensured requiring "Melnikov non-resonance conditions" among 
the frequencies and further non-degeneracy conditions. 

In light of these results, the spatial planetary three body problem (in the small 
eccentricity-inclination regime) has been recently reexamined in [BCV], where the per- 
sistence of two-dimensional elliptic invariant tori -with diophantine frequencies- has been 
proved, provided the Keplerian major semi-axes belong to a two dimensional set of pos- 
itive measure. 

Previous works on the spatial planetary three-body problem are [JM] , for large incli- 
nations (in this case the two-tori are hyperbolic), and [LR]-[R], for maximal dimensional 
tori (the proofs are computer assisted). 

In the present paper we first prove, under suitable non-resonance and non-degeneracy 
"twist" conditions, a general Birkhoff-Lewis type result showing the existence of infinitely 

many periodic solutions, with larger and larger minimal period, accumulating onto el- 
liptic lower dimensional invariant tori, sec Theorem 1.1 for the precise statement. 

Furthermore we prove the applicability of Theorem 1.1 to the spatial planetary three- 
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body problem, showing the existence of infinitely many periodic solutions accumulating 
on the elliptic KAM tori of [BCV], see Theorem 0.2. Such periodic orbits revolve around 
the star close to Keplerian ellipses with small eccentricities and small non-zero mutual 
inclinations. The verification of the "twist" condition (Lemma 5.1) is based on a KAM 
analysis. 

Finally, in Theorems 0.3, O.4 we prove the existence of other periodic solutions of 
the spatial planetary three body-problem, the "periodic analogue" of the elliptic tori of 
[BCV], see Theorem 6.1 for a more general statement. 

We now present a simplified version of our results. 

Periodic orbits accumulating on elliptic tori. As already said, the persistence 
of elliptic invariant tori is ensured assuming "Melnikov non-resonance conditions" among 
the frequencies. In particular, under the "second order Melnikov conditions" (see pre- 
cisely (4)), the surviving tori are still elliptic and the normal form Hamiltonian describing 
the dynamics in a neighborhood is 

7Y*(X)t, Lp^, Z^, Z^) — to ■ -\- VtZu, ■ Zn, -\- R^^^-(^ip^)I^ Z^ Z ^ , 

2|fc| + |o+o|>3 

where (J*,v9*) G R" x T'^ and (Z*,Z*) e C^"". In these coordinates T := {X^ = 0, 
V?* G T", = = 0} is the invariant and elliptic torus, cu e R"^ are the torus 
frequencies and Q G R™ the elliptic one's. 

We refer to [JV] and [BHS] for many results concerning the dynamics of an Hamil- 
tonian system close to an elliptic torus, in particular for the existence, under appropiate 
non-resonance and non-degeneracy conditions, of Cantor families of other invariant tori 
of dimensions greater than n. 

Also for proving the existence of periodic orbits accumulating onto the elliptic torus 
T we need to assume suitable non-resonance and non-degeneracy "twist" conditions. 
Roughly (see Theorem 1.1 for the detailed statement) we have: 

Theorem 0.1 Under suitable non-resonance and non- degeneracy conditions, the Hamil- 
tonian system generated by 7i* affords infinitely many periodic solutions, with larger and 
larger minimal period, accumulating on the invariant elliptic torus T. 

The precise Theorem 1.1 and a description of its proof are given in Section 1. Theorem 
1.1 implies, in particular, the result of [CZ] for maximal dimensional tori. 

The planetary, spatial three body-problem. Let e > denote the small pa- 
rameter measuring the ratios between the masses of the planets and the mass of the star 
(see (92)). The existence of two-dimensional elliptic invariant tori has been proved in 
[BCV]. Roughly (see Theorem 5.2 for a precise statement and proof) their result states: 

Theorem ([BCV]) The spatial planetary three-body problem affords, for e small en- 
ough, a family T of two-dimensional, elliptic invariant tori, travelled with diophantine 
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quasi-periodic frequencies, provided the osculating Keplerian major semi-axes belong to 
a two-dimensional set of density close to one (as e tends to 0). 

We will prove, in section 5, that: 

Theorem 0.2 The spatial planetary three-body problem affords, for e small enough, in- 
finitely many periodic solutions, with larger and larger minimal period, accumulating 
onto each elliptic invariant torus of the family T . 

The proof of Theorem 0.2 boils down to check that the non-resonance and non- 
degeneracy twist conditions of Theorem 1.1 are fulfilled for the spatial planetary three- 
body problem. This task is accomplished by estimates based on a careful KAM analysis. 

Finally, in section 6, we prove the existence of other periodic orbits of the spatial 
planetary three-body problem, the "periodic analogue" of the elliptic tori of [BCV]. 
More precisely, let consider the integrable (i.e. e = 0) three-body problem when the 
two planets revolve around the star along circular orbits without interacting [decoupled 
two-body systems). Some of these motions will be periodic with, say, minimal period T. 
Taking into account the mutual interaction between the planets (i.e. £ > 0) we prove the 
existence of, at least, two, slightly deformed, T-periodic orbits. The parameter e must 
belong to a suitable interval of values depending on the period T. 

Theorem 0.3 There exist Tq > and functions < e{T) < e{T), defined for T e 

[To, oo) and decreasing to zero as T +oo such that, for any circular periodic orbits of 
the decoupled three-body problem with minimal period T > Tq, for all s{T) < e < s{T), 
there exist at least two, e- close, geometrically distinct T-periodic orbits of the spatial 
planetary three-body problem. 

The following Theorem can be seen as an e-fixcd version of Theorem 0.3, requiring, 
for fixed small values of the masses of the planets, restrictions on the period T. 

Theorem 0.4 There exist Si > and functions < T(e) < T{e), defined for e G (0,ei] 
and tending to infinity as e ^ 0, such that, for all < e < Si and for any circular 
periodic orbit of the decoupled three-body problem with minimal period T^{e) <T< T{e), 
there exist at least two, e-close, geometrically distinct T-periodic orbits of the spatial 
planetary three-body problem. 

A more general Theorem implying Theorems 0.3 and 0.4 is given in Theorem 6.1. 

The paper is organized as follows. In Section 1, we give the detailed statement of 
Theorem 0.1, namely Theorem 1.1, and wc discuss its proof. Section 2 collects some 
number theoretical Lemmata used in Section 4 for defining the "non-resonant" periods 
T. Section 3 is devoted to a normal form averaging result. The proof of Theorem 1.1 is 
addressed in Section 4. In Section 5, after recaUing the Poincare-Delaunay formulation 
of the spatial planetary three-body problem, we prove, first, a finer version of the KAM 
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result of [BCV] and, finally, Theorem 0.2. Section 6 contains the proof of Theorems 0.3, 
0.4 and 6.1. 

Acknowledgements: We thank P. Bolle and L. Chierchia for many interesting discus- 
sions. Part of this paper was written when the last two authors were visiting SISSA in 
Trieste. They thanks SISSA for its kind hospitality. 

Notations: We denote by O(^) a real analytic function whose norm is bounded by 

C^, for a suitable constant C > and V < ^ < ^o- Mat(n x n, R) (rcsp. Mat(n x n, C)) 
is the set of n x n matrices with real (resp. complex) coefficients and 1„ the n x n 
identity matrix. Br denotes the (closed) ball of radius r centered at 0, 5" the closed 
ball of radius r centered at using the | • I2 norm, and D'^ the complex d-ball of radius 
p centered at 0. ^A is the cardinahty of the set A. gcd is the greatest common divisor 
and 1cm the least common multiple. We set Cj := (0, . . . , 1, . . . , 0) £ Z"^ the i-th unit 
versor and |a|i := J2i=i kli norm. Through the paper Cj,Cj, const, will denote positive 
constants possibly depending n, m, uj, fl, 7, r, r, s, p, R*, etc. 

1 Periodic orbits accumulating on elliptic tori 

We now give the precise statement concerning the existence of periodic orbits close to 
elliptic tori (Theorem 1.1). Let consider Hamiltonians of the form 

T-C^{I^,ip^, Z^, Z^) = UJ ■ + ■ + ^ Rl^^-^{ip^)I^Z^Z^, (1) 

2|fc| + |a+a|>3 

where (X*,(/9*) G R" x T" arc action-angle variables and (Z*,Z^,) G C^™ are called the 
normal (or elliptic) coordinates. The phase space R" x T" x C" x C™ is equipped with 
the symplectic form^ dl^ A d(p^ + \dZ^ A dZ^. 

UJ e R" is the frequency vector and Q :=diag(ili, . . . , Q^rn) is the m x m diagonal 
matrix of the normal (or elliptic) frequencies. Hence QZ^ ■ denotes J2i<j<m^j^*j^*j- 
We will often identify the diagonal matrix Q with the vector {Qi, . . . , Q^) ^ R-™"- For the 
multi-indexes k G N", a, a G N™ wc define \k\ := 1]"=! \a\ := Y^"Li (i-jj := SjLi Q^j- 

The Hamiltonian is assumed to be real analytic for {l^,(p^, Z^, Z^) G -D"^ x 
T"^ X Dp'^ C C^"'+^'" for some positive constants r^,s^,p^. ^ Real analytic means that 
7^* is real analytic in the real and imaginary parts of Z^. The functions Rk,a,a{v*) can 
be expanded in Fourier series as 

Rl,aM)= Rl,ara,e^''-^' ■ (2) 

^Wc denote the imaginary unit by i (not to be confused with i often used as an index). 

'^We have used the following standard notations: for a given set A C R'', d G N+ and 6,s > 0, we 
denote by Af := {z e \ dist(^, A) < 6} and Tf := {z e \ |Im Zj\ < s, V 1 < j < rf}. Moreover 
Dl := {zeC' \ \z\ < S}. 
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Since n^{I^,ip^, Z^, Z^) e R for all {I^,(p^) e R** x T'* and for all e C"", the 
Taylor- Fourier coefficient R%^a,a,t satisfy 

The frequency vector is assumed to satisfy the "second order Melnikov non- 

resonance conditions" 

\u;-e + n-h\>-^-^ , yeez\hez"^ ,\h\<2,(e,h)^(o,o) (4) 

for some positive constants 7, r. We will use such condition in order to perform the 
averaging procedure of Section 3. 

By condition (4), the frequency uj is rationally independent^ (actually Diophantine), 
while {cu, Q) can possess some resonance relations which can be described as follows. 
Eventually reordering the frequencies flj, there exists < m < m such that^ uj : = 
[u, ^lrh+i7 • • • ? ^m) is rationally independent on Z'^, where n := n + m — m, but {uj, Qj) 
is rationally dependent for all 1 < j < m (m is the number of resonances). This means 
that there exist Mj e N+ and Uj e Z" such that''' 

MjQj = ttj ■ UJ with gcd (aji, . . . , a^jj, Mj) = 1, VI < j < rh. (5) 

The Hamiltonian system^ 

Z), = —d^pJH^ , 0* = dx^Ti.* , Z^ — xd-^l-i^ , Z^ — —idz,,'H* (6) 

possesses the elliptic invariant torus 

r := {(X,, Z,,Z,) e R" X T" X C'" | X* = 0, Z, = Z, = o} 

supporting the quasi-periodic solutions (0, 99*0 + 0, 0). 

We define the symmetric "twist" matrix TZ e Mat(n x n, R) 

(1 + ^i,i')R*ei+ei,, 0,0,0 ~ X! , , f j_ O {^*ei,ej,0,e^X,,0,ej,-t + ^*ei,0,ej,-e^*ei, ,ej,0,e) ) 

l<j<m • t -r iij 

(7) 

where Rlaae Fourier coefficients, introduced in (2), of RXaai^*) '■~ ^ 

i = i' and if i 7^ i'. We also define the matrix Q G Mat(m x n, R) as 

£., , , 
p* \ ^ \ / p* p* I p* p* 1 

ji ■— ^ei,ej,ej,0 ^ _ ^ ^ {^ei,ej,0,e^ei, ,0,ej,-e ^ ^ei,0,ej,-e^ei, ,ej,0,e) 

l<j'<7Tl J 



H.c. uj-l^O, V^e Z". 
^if m = m we set u) := u). 

^We denote by gcd and 1cm the greatest common divisor and the least common multiple, respectively. 
^Setting = (P* + iQ,)/V2, = (P^ - iQ*)/V2 with (P*,(3*) e R^™ the last two equations are 
equivalent to Q* = dp^T-L^P* = —dq^H. 
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for 1 < j < m, 1 <i <n. We stress that TZ and Q are real matrices by (3). 
We now give the precise statement of Theorem 0.1. 

Theorem 1.1 Let the Hamiltonian m (1) be real analytic in D^^ x T^^ x and 
satisfy condition (4) . Assume the "twist" condition det TZ ^ and one of the following 
"non-resonance" conditions: 

• (a) one of the three cases below holds: 

— (i) m = 1,2 [low number of elhptic directions), 

— (a) m — (no resonances among {u!,fl)), 

— (Hi) Mj>m>l, VI < j < m ; 

• (b) a min UQ - Qn-^u})A > ; 

l<j<m 

where m and Mj are defined in (5) . 

Then, there exist riQ,Co,Ci > ^ such that: Wrj G (0,?7o], there exist an open set 
of periods Ar^ C ^ + Cq] with measure greater than I/Cq such that VT G Arj there 
exist k := k{T) G Z"-, uj := uj{T) G R", with ujT = 27ik, \uj — uj] < Ciff , and at least n 
geometrically distinct T -periodic solutions Cvi^) — i^*ri{t)j f*'n{t), Z^^{t), Z^^{t)) of the 
Hamiltonian system (6) satisfying 

In particular, the closure of the family of periodic orbits Cr? of (6) contains the ellip- 
tic torus T. Moreover the minimal period Tmin of C,r) satisfies Tmin > T^^^'^'^^^Ci — 

Idea of the proof of Theorem 1.1. Since (cj, Vt) satisfy the second order Melnikov 
non- resonance conditions (4), in view of an averaging procedure (Proposition 3.1), the 
normal form Hamiltonian is, in a suitable set of coordinates (/, 0, z) G x 
rpn ^ c^"*, and sufficiently close to the torus T, a small perturbation of the integrable 
Hamiltonian 

Hint ■.^u;-I + ^ni • 7 + Q^z + rfQI ■ zz, 

where 77 > is a small rescaling parameter measuring the distance from T. The Hamilto- 
nian system generated by Hi^t possesses the elliptic tori T(/o) := {/ — Iq-, G T", z — 
0} supporting the linear flow t {/q, (/)o + (u; + ri^TZlQ)t, 0}. On the normal space the 
dynamics is described by i = ir2^(/o);s where 0^(/o) := f2 + rfQIo is the vector of the 

^Such constants may depend on n, m, oj, fl, 7, r, r*, s*, p*, i?^ ^ m, Q, a. 
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"shifted elliptic frequencies". Our task is to find periodic solutions bifurcating from the 
ones of Hint- 

The system is properly nonlinear by the "twist condition" det TZ ^ (see remarks 
4.3 and 4.4 for a comment). Such condition involves only finitely many Taylor coefficients 
Rl^-^ of the normal form Hamiltonian Tt* and ensures, in particular, that the frequencies 
cu + t^TZIq vary with the actions /q. When 

cD := a; + ri^nh e ^2nZ'\ 

T(/o) is a completely resonant torus, supporting the family of T-periodic motions V :— 
{I{t) — /q, = 00 + ^t, z{t) = 0} (completely resonant frequencies cD G (27r/T)Z"^ 
always exists for some T = 0{ri~'^) and Iq = 0(1), see (69), (70)). The family V, 
diffeomorphic to T", will not persist in its entirety for the complete Hamiltonian system 
due to resonances among the oscillations. 

The key point to continue some periodic solutions of the family V is to choose 
properly the "1-dimensional parameter" T (the period) and the actions Iq: the period 
T and the "shifted elliptic frequencies" flriih) must satisfy a suitable non-resonance 
property, see (68). 

In Lemma 4.1 (resp. 4.2) we actually show the existence, assuming condition (a) 
(resp. (6)) in Theorem 1.1, of "non resonant" periods T. Note that in condition (a) 
the "coupling matrix" Q does not play any role (in particular for m — 2 which is the 
case of the spatial three body problem). If conditions {a)-{ii)-{iii) are not verified, the 
system possesses "lower order" resonances (sec equation (5)), which arc an obstruction 
for finding "non-resonant" periods T. In this case one needs, in order to "move away" 
from the resonances, to evaluate the matrix Q and check condition (b). Conditions {a)-{b) 
are, indeed, sharp: if violated, it is not possible, in general, to find any "non-resonant" 
period T, see remark 4.1. 

After the previous construction, the proof of Theorem 1.1 is based on a Lyapunov- 
Schmidt reduction, variational in nature, inspired to [ACE]-[AB]. The non-resonance 
property (68) and the "twist condition" detTZ ^ 0, allow to build, by means of the Con- 
traction Mapping Theorem, a suitable family of pseudo- T-periodic solutions branching 
off the family P, see Lemma 4.3. Finally, by a variational argument, we will select at 
least n (= cat T**"^) geometrically distinct T-periodic solutions from them. 

Finally, we recall that, for strictly convex nearly integrable Hamiltonian systems, 
[BK] have proved, via a variational argument, the existence of periodic orbits with arbi- 
trarily large minimal periods. We have not tried to extend their approach in the present 
case, since the unperturbed Hamiltonian H^nt is not-strictly convex (it is linear in the el- 
liptic action variables zz). Moreover the previously described phenomenon of resonances 
between the period T and the "shifted elliptic frequencies" is hardly recognizable by a 
purely variational approach (which works well for finding periodic orbits near maximal 
dimensional tori and problably near hyperbolic one's). 
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2 Study of the resonances and technical Lemmata 



In this section we first collect some number theoretical Lemmata that will be used in 
section 4 for defining the "non- resonant periods" T (Lemma 2.3 will be used in Lemma 



Lemma 2.1 Let Z, M e N with gcd ( 0,1, ... , Qjii 

M) = 1. Then, eZ, 
the congruence aiki + . . . + a„A;„ = b modM has M'^~^ solutions. 

Proof: Recall a well known result from number theory: let a,b,M G Z and c : = 
gcd(a,M); then the congruence ak = b modM, A; G Z, has solution if and only if^° 
c\b and in this case it has exactly c solutions. It means that there exist integers < 
A;i < . . . < A;c < M - 1 such that akh - b E MZ yi < h < c, hut ak - b ^ MZ 
yke{0,...,M-l},kj^khWl<h<c. 

We now prove the Lemma by induction over n. The case n = 1 is the above men- 
tioned result. We now suppose the statement true for n and prove it for n + 1. Let 
c := gcd {ttn+i, M). Our congruence is equivalent to a„+i/c„+i = (6 — X^ILi '^i^i) modM 
which has exactly c solutions if and only if c| {b — Yh=\ cbiki) . Hence we have only to 
prove that the number of integers < /ci, . . . , A;„ < M — 1 for which c\{b — YL^=\ O'iki) 
is exactly M^^/c = c"-^^{M/c)^. This amounts to prove that the number of integer so- 
lutions of aj/cj = 6 mode, is exactly c"'~^. This is true, by the inductive hypote- 
sis, if gcd (ai, . . . , On, c) = 1. The last equality is actually true since, by hypotesis, 
gcd (ai, . . . , a„+i, M) = 1; hence if d\ai, . . . ,an,c, since c|a„+i, M, then d|a„+i, M and it 
follows d—1. □ 

Lemma 2.2 Let 7h,n E N"*". Let Cj G R" rationally independent. Let Vt G R™' with 
MjClj = Qj ■ LJ for Mj G ttj G Z". Suppose that gcd{aji, . . . ,ajn, Mj) — 1. Let 
M := 1cm (Ml, . . . , M^) and K := {0, . . . , M - 1}". Suppose M,- > m, V 1 < j < m. 
Moreover, in the case m = 1, suppose also Mi > 2. Then there exists k E K such that 
aj -k/Mj ^ Z, VI < J <m. 

Proof: Let A^- -.^ {k E K s.t. aj ■ k e MjZ}, A* := {k G Kj s.t. aj ■ k E MjZ}, where 
Kj := {0, . . . , Mj - 1}". Since Mj\M we have^^ ^Aj = {M/Mj)%A*. Using Lemma 2.1 
with the substitutions n — > n, 6 — > 0, — > aji, M Mj we obtain that ^A* = M^~^. 
Hence we have fJAj — M'^/Mj. Observing that {0} G Aj VI < j < m, we have 



If m > 2, since Mj > m by hypothesis, then -m + M^Y.f=i ^ < -m + M^ < -1 + M". 
If m = 1, since Mi = M > 2 by hypothesis, -m+M" EJLi ]^ = -l + M^-^ < -1+M". 



4.1). 



ttU(A,\{o})<Ett(^.\{o}) = E 



j=l j=l j=l 



m m m 




(9) 



^'^c\h means that there exists n E Z such that b = cn. 
^^We denote by {(A the cardinahty of the set A. 
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In both cases, from (9), we get 

u \ {0}) < -^ = m\ {0}) 

and the conclusion of the Lemma follows from H ^'JLi < tt-^- ^ 

In view of the next Lemma we recall the definition of the ergodization time of a 
torus with linear flow. For any vector ^ e the ergodization time T'erg(^, e) required to 
fill T" within £ > is defined as 

Tcrgi^, e) := inf {t e R+ I Vx e R^, V 1 < i < n, dist(xi, A + [0, t]^i + Z) < e} (10) 

where A is some point of R". Tcrg(^,e) is clearly independent of the choice of A. 

If {ui, Q) are rationally independent or are resonant only at a sufficiently high order, 
namely if (a;, Q) • p 7^ 0, Vp e Z""^"* with < \p\ < a/6 ior some constant a :— 
an,m, then the trajectories of the linear flow {{uj,fl)t}t^ti will make an arbitrarly fine 
5-net of T"'"'"™', see Theorem 4.1 of [BBB]. This non-resonance assumption on {uj,Q) 
is clearly sufficient to prove (13)-(14) below. In the present case, however, the weaker 
non-resonance assumptions (11), (12) are sufficient. 

Lemma 2.3 Let Mj^aj^ifi as in (5) and suppose that 

Mj>m Vl<j<m. (11) 

In the case rh — 1 — Mi suppose also 

3n + l<i^<n = n + m — 1 such that au^ 7^ . (12) 

WO < S < 1/(2/3), where j3 := 2maxi<j<TO|aj|i, and Vto > 0, there exists t > to such 
that 

dist(a;ir, Z) < 6 V 1 < i < n , (13) 

dist(Q,T, Z) > min i , — I do Vl< j < m . (14) 

^ ' ^ ~ [2(3' 4maxi<,<rf,Mj - - ^ ^ 

Moreover t - to < %,^{uj/M, 5/M) where M := 1cm (Mi, . . . , M^). 

If {u!,fl) are rationally independent, namely m = 0, (13)-(14) are still verified setting 

P := 2, do := 1/4, M := 1. 

Proof: We first consider the cases m>2orm = l< Mi. We are in the hypoteses 
of Lemma 2.2. Hence there exists k e K := {0, . . . , M — 1}" such that aj ■ k/Mj ^ Z, 
V 1 < J < m. Let^2 



^^We define ((yi, . . . , yn)) := ((j/i), . . . , {Vn}) where the function (•) : R ^ [~l/2, 1/2) is defined as 
{y) := y ior y & [—1/2, 1/2) and it is 1-periodically extended for y e R. Note that, for y ^ (1/2) -|- Z, 
{y) = y ~ [y] where [y] is the closest integer to y. 
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Since Cj/M is rationally independent, its linear flow ergodizes the torus R"/Z". Let 
^0 < ^ < ^0 + Tcrg(cj/M, 5/M) the first instant for which 3h e Z" with |^(r - to) - a: - 
h\oo ^ S/M. If y : = ujt — k — ^ J2^=n+i '~ then, by a suitable choice of h' G Z", we 
obtain by the construction above that \y\oo < S. Hence, by definition of a), VI < i < n, 
cUiT — uJiT — Vi + ki — Mh[ and (13) holds. 

Moreover, from the resonance relation (5), VI < j < m, 

^ ■ LOT ttj ■ y ttj ■ k 1 J\ M , , ,^ ^, 

M,- /?M, -i;, M,. ^ ^ > 

We observe that • k/Mj ^ Z implies dist(aj • k/Mj, Ti) > l/Mj. Also, 1% • y\ < \aj\iS, 
I S?=n+i%il — Hence, collecting these observations and (15), we have 

dist(n,T, Z) > — - -\^>J— Vl<i<m, (16) 

recalling also that < 6 < (1/2(3) and the definition of j3. Finally, by definition of lj, for 
rh + 1 < j < m, we have QjT = LVn+j-mr = yn+j-m+ kn+j-m + Mh'^^j_^, which 

implies 

1 1 

dist(^T, Z)>--5>— Vm+l<j<m, (17) 

(j Zp 

and (14) follows from (16)-(17). 

We now consider the case m — 1, Mi = 1. We have M = Mi = 1. We set a :— ai to 
simplify the notation. Let 

h 

i=n+l 



where 

sign(aij 



if Oj 7^ , 



2 J2i=n+1 

if Qi — . 



2\a\i 

Note that > l/(2|a|i) for all i. Proceeding exactly as above we find to < t < 
to + Terg(a), S) and an h' e Z" such that, defining 

h 

y -.^LOT- J2 biSi - h\ 
i=n+l 

we have |y|oo < S and (13) holds. The proof of (14) is shghtly different. For j = 1 we 
have 

" 1 
QiT — a-ur — a-y + a- ^ biei + a-h' — a-y + - + a-h' , 

i=n+l 2 
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where, in the last cquaUty we have used (12) abd the definition of 6j. Since a ■ h' & Z 

and \a ■ y\ < \a\i6 < 1/4 we have 

dist(fiir,Z)> 1-1 = 1. (18) 
Instead, for 2 < j < m we have Jl^r = uJn+j-iT — yn+j^i + bn+j-i + h'^_^.j_i which imphes 

dist{fljT,Z)>bn+j-i-5>-^-S=l-5>^ V2<j<m, (19) 

p Zp 

and (14) follows from (18)-(19). 

We finally consider the case m = 0, which is the simplest one since the linear fiow 
oi CO — {uj, il) ergodizes the whole torus T"+"^. Let define 

-j^ n+m 
^ i=n+l 

There exists to < "T" < + ^erg('^, S) and h e Z"+"* such that |a)(r — t^^ — x — < S, 
with < 5 < 1/4. Arguing as before we get \ujt— (1/2) Yd^^i e, — /i'|oo < 5 for a suitable 
h' e Z""^"* and the estimates (13)-(14) follow. The Lemma is proved. □ 

The next two Lemmata, whose proof is omitted, will be used in the proofs of Theo- 
rems 1.1 and 0.2, for constructing the pseudo periodic solutions through the Contraction 
Mapping Theorem. 

Lemma 2.4 Let {X, \ • \x) and {Y, \ • |y) be Banach spaces, L : Y — > X be a linear 
bounded operator and P : X — > Y be a map. Assume that 

5o>2|L(P(0))U (20) 

and 

sup \DP{x)\<-^ (21) 
Then, there exists a unique x* G -B^^ such that x* = L{P{x*)). 

The next Lemma defines a suitable "Green operator" L associated to the linear system 
(2.5) below. 

Lemma 2.5 Let T > 0, D, e Mat(m x m, R), M e Mat(n x n, R) and define M := 
Im — e^^"^ e Mat(m x m, C). Assume that M and M. are invertible. Let 

Y := C([0,T], R" X T'^ X C™) , (22) 

X := {(j,V',-z) ey s.t. ^(o) = V'(r) = 0,^(0) = ^(r)}. (23) 
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X andY , endowed with the sup-norm 11(7,-0,^)11 := sup^^jQ^j^jd J(i)|, are 
Banach spaces. 

For any (J, ip,z) &Y define the constants 



q;(J,'0) 

m 



JO 



J{9)d9ds + M-^ jP{9) de) 



e R" 



(24) 



T 

A^-^e'^^ e-'^^'zie) de e C 
Jo 

and the linear "Green" operator L : Y — > X by 

/ a{J,ip) + lo As) ds 

L I i; I := Mat + M J{e) dO ds + /„* V(^) dO 
e^^^(^(3{z) + J^e-'^^z{e)de) 

The Green operator L satisfies 

\L\ < C (|M-i| + \M\ + |M| \M-^\ T + \M~^\t) , 

for a suitable constant C > depending on sup^^jQ |e'^*|, n and m. 
Setting {J,ip,z) — L{J,ip,z), then {J,ip,z) e and 

j = J, 
ip - M J = ^, 
z — iilz — z . 

The straightforward proof is omitted. We only point out that L{Y) C X by definition of 
the constants a{J,ip) and (3{z). 



(25) 



3 Normal form around an elliptic torus 

In order to study the dynamics of the Hamiltonian system (6) in a small neighborhood 
of T it is a convenient device to perform the following rescaling 

2* := rj'^I , := rjZ , := rjZ, (26) 

where ?] > is a positive small parameter. Note that the linear tranformation (26) 
preserves the torus T and that a domain of order one in the new variables {I, (f, Z, Z) 
correspond to a domain in the old variables (X*, (fi^,Z^, Z^) that shrinks towards T for 
77 tending to zero. 

The new Hamiltonian 7i{I,(p, Z, Z) = r]~^7i*{r]'^I , (p, r]Z, rjZ) writes 

n{i^, z,z)^u;-i + nz.z+ ^ n'\''\+\^+^\-'Ri^^Mi'z^z^ (27) 

2|fe| + |o+a|>3 
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and it is analytic on 



In order to find periodic solutions with large period close to the elliptic torus T we will 
apply in section 4 a finite dimensional reduction of Lyapunov-Schmidt type. For this 
purpose (see remark 4.2) we need first to perform a symplectic change of variables which 
eliminates from the Hamiltonian Ti. defined in (27) the following terms^^ 

ri E K,a,M^iZ''Z\ (28) 

l<i<n 

\a+'a\ = l 

E ^M,o/^'e'''^ (29) 

\k\=2,e^o 

E K,ara,e^^Z''ZV'■\ (30) 

l<i<n 
|a+a|=2 
a^a or 

r)' E Rl,a,M^'Z'^z'' . (31) 

2|fc| + |a+3|=5 
|a+a|=l 

This task will be accomplished in the next Proposition. The term (29) will be "averaged 
out" since u is diophantine; the terms (28) and (31) using the first order Melnikov non- 
resonance conditions (namely conditions (4) for \h\ < 1), and, finally, the term (30) using 
the second order Melnikov non-resonance conditions (4). 

Proposition 3.1 (Averaging) Let the Hamiltonian H, defined in (27), be real analytic 
on D" X T" X Dp"^ and satisfy the second-order Melnikov non-resonance conditions (4). 
Then, forrj small enough, depending on n, m, uo, Vt, 7, t, r, s, p, there exists an analytic 
canonical change of coordinates $ : (/, 4>, z,z) — >• (X, ip, Z, Z), rj-close to the identity, 

$ : L',"/^ X T:/2 X Dlf^ D^^ x x Df^ , 

transforming the Hamiltonian H into the Hamiltonian^^ 

|a+a|=3 



+ r,^\^-ni-I+QI-ZZ+ Y R^,a,a{<t>Vz- 



"2 |a+a|=4 



+ 



+ Y Rk,a,am'^''^+0{V') , (32) 



2|fc| + |a+a|=5 
|a+a|=3,5 



for suitable Rk,a,a ^ C, Rk,a,a{'P) analytic on T"y2; (ind where IZ is the symmetric twist 
matrix defined in (7) and Q e Mat(m x n, R) is defined in (8). 



^^For short, in the sequel we will often omit the summation over ^ S Z". 
^*We denote QI ■ zz := Y^i<3<m QjiliZjZj. 
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Proof: We rewrite the Hamiltonian (27) in the form 



n{X,v, Z,Z)^Y1 V'Ri'Kl'P, Z, Z) (33) 

j>0 



with 



R(:>^:=u;-I + QZ.Z and R^^ -.^ ^ it:*,„,^,,X'=Z"ZV-^ (34) 

2|fe|+|a+a|=j+2 

where we have expanded in Fourier series the functions R%g.-^{ip) as in (2). 

We want to define a canonical change of variables $ from the new variables C, : = 
(/, 0, z) to the old ones Z :— {I, (f, Z, Z), as the flow at time 1 of a suitable Hamiltonian 
X- Precisely $ := where $^(Co) '■— C(^) is the unique solution of the Hamiltonian 
system 

i(t)^-d^xm): m = dixm), m = i9,xm), ^t) ^ -id^at)) 

(35) 

with initial conditions ((0) = (q. 

The Lie operator (Poisson brackets), acting on a function g := g{C), is defined as 

Lx9 — {9: X} d4,gdix - djgd^x + ^d^gd^X - ^d^gdzX- (36) 
For every integer j > we also set 

L^g g , L{g L^L{-^g . (37) 
The new Hamiltonian H — Ho^ can be developed, for all jo ^ N+, as 

jo 

jJoJ'- " Jo 

We look for a Hamiltonian x of the form 

jo 

X-J2v'X^'^ , where x^^^ X^'\l,<f>, z,z) :^ ^ Xk,a,a,d'z'^z^e''-'» (39) 

j=l 2|fe| + |a+a|=j+2 

will be chosen later on. For the sake of simplicity we will often omit in the notation the 
summation over i e Z"^. Inserting (39) in (38) we obtain 

jo ja jo 1 d-1 

H = Y. v'R^'^ + E E -y E E ^x(^i) ■ ■ ■ L^i^.^Ri'^ + ow^^') (40) 

d=0 d=l j=oJ- h=0 /i+ii+...+ij=d 

Denoting [ ■ ]d the d-th order in 77, we obtain 

= (41) 



H:^no^^± ^L^^n + f (1 - OL^^'H o $5 ■ (38) 
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and 

io 1 d-l 

[HU^Rf^+L^ia^R^^'^ + JZ-ji: E L^in) . . . Lu,M'^ . (42) 



j=0^' h=0 h-\-ii-\-...-\-ij=d 
l<i]^ <.d—l 



Observe that 



J2 {I^'z^z^d'-'^ , I' z'^ r e^^ -^j = (43) 

2\k\ + \a + a\ = h + 2 
2\k'\ + \a' + a'\ =h' +2 

Ck",a",a",e"^ Z Z e ^ , (44) 

2\k"\+\a"+a"\=h+h'+2 

for suitable constants c^" ,a" ,a" ,e" ^ which are exphcitly given by the following formula: 

n 

{Ik^'^^^ii-'t' ^ jk'^a'^'^u'-<py ^ i\Y,{iik[-e[ki)l''+'''-''z''+'''z^+^' + (45) 



i=l 



+ '^{cLj'a'j — cijCij)! 



z ■' z 



Thus, we obtain that 



L^(.,) . . . L^(.,)it:f ) = E Ck,a,a,el''z''re''-'t' (46) 

2\k\ + \a+a\=h+ii+...+ij+2 

for suitable constants Ck,a,a,e- Hence, 

= Yl Rk,a,a,d'z^t'e''-'^ (47) 

2|A;|+|a+a|=d+2 

for suitable Rk,a,a,i with 

Rk,a,a,^ Rk,a,7lAX^'\ ■ ■ ■ , X^'"'\ ■ ■ ■ , 4'^) i (48) 

we note that, by means of (41) and (47) 

2|A;| + |a + a| = 3 =^ Rk,a,a,e = Rl,a,a,e , (49) 
(recall also the setting in (34)). We also evaluate 

= {^■I+^zz,x^''^} = E -i{u;-e+n-{a-a))xk,a,a,el''z''z^e''-'t' . (50) 

2|fe|+|a+a|=d+2 

We define the following "resonant" set: 

S := SiUS2US3C {{k,a,a,£) s.t. 3 < 2|A;| + |a + a| < 5 , £ e Z"} , (51) 



17 



with ^2 = -^2° U ^2^ U SI and 





— {k — 0, \a + a\ 


= 3, ^ e Z"} 


SI 


— {k — 0, \a + a\ 


= 4, £ e Z"} 


si 


— {k — Ci, a — a 


= Cj, 1 < i < n, 1 < J < m, £ = 0} 


SI 


= = 2, a = a 


= 0, ^ = 0} 


Ss 


= {2|A;| + |a + a| = 


= 5, |a + a| =3,5, £e Z"} . 



Let Jo = 3. V 1 < (i < 3, \/{k,a,a,i) such that 2|A;| + |a + a| = d + 2,£ e Z", one can 
check, by condition (4), that 

{k,a,a,e)^S =^ \u;.e + n{a-a)\>:^^j^, (52) 

and hence we can define 

r if {k,a,a,i)eS 

Xk,a,a,i ■ I .e + n{a- a)]-'Rk,a,a,e otherwise ^^""^ 

In light of this construction, using (47) and (50), we have^^ 

2|fc| + |a+a|=d+2 (k,a,a,t)eSd, 

Define 

-Rfc,a,a Rk,a,a,0 i Rk,a,a{(p) '■= E ^k,a,a,i^^^ ■ 

By recurrence, using (47), it is possible to evaluate the terms Rk,a,a explicitely. 
Prom (42) and (49) we have 

Noting that 
we have 

M^{«<" + n,«i').,a.}.«.)) . 

^^We denote by II^, where S C N"+^™ x Z", the projection on S i.e. 

si 2^ Ck,a,a,e-l Z Z e ^ \ := Ck,a,a,l^ Z Z B ^ . 
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In order to prove (32) we only need to show that 

\ni.i = iis.m = \iis.[{R^P.x^'^})+iisiRf\ (55) 
= n,. ({^n,.i?« + iis,R^}\ x«}) + n,.4^) , (56) 

where SI := {A; = e^, |a + a| = 1, £ G Z'^, 1 < i < n}. 

We first prove (55). Using (39), (53) and (45), we have 

m 1 /?* _ /?* 



\a + a\ = \a' + a'| = 1 
a + a' = a + a' = ej 

+ X] -^fe,o,o,o-^^ 

|fe|=2 

m -1 R* R* 

, , , 2 • -a;-£ + Q(a-a) ^"^"^- " 

|a + a| = |a' + a'l = 1 
a + a' = a + a' = 

A 1 + ^i,V . . 

2 -"-ei+Ei' ,0,0,0-' j-'i' 

i,i'=l 

i,i'=l 

where = 1 if i = i' and if i 7^ i' . Here, we observe that, since |a + a| = la' + a'l = 1, 
if a + a' = a + a' = Cj, then {a, a, a', a') = (ej,0,0,ej) or (0, ej,ej,0). So (55) directly 
follows from (57). 

We now prove (56). Using again (39), (53) and (45), we have 



l<i'<n 
l<j'<m 



^ \<U<n V ^' 



^ Z -\- — Z 'f 



l<j'<m 
\a + a\ = 1 
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+ E (^0 

l<i<n [_ 



ID* 



"J' ) 



l<z,z'<n \ J J 

l<j<m 

~ E ~ /) I o {■^0,ej,ej+ej,-e^ei,ej,,0,e''l'^0,ej+ej,,eje^ei,0,ej,-e^^ 

l<i<n • -t -r iij' 

+n5,i E ■ (58) 

2|fc| + |a+a|=4 

So (56) directly follows from (58). 

The estimate on the new analyticity radii follows from (52) and from the fact that 
X = 0{7j) (see (39)). □ 



4 Periodic orbits winding along the torus 

In this section we prove the existence of periodic solutions of longer and longer (minimal) 
period shrinking closer and closer to the elliptic torus T (Theorem 1.1). 

By Proposition 3.1 the Hamiltonian (27) can be transformed, thanks to the second 
order Melnikov non- resonance conditions (4), into the Hamiltonian 

H{I,(P,Z,Z) = U-I + nzZ + V E K,a,ai<t>>"^^ 

\a+a\=3 

+ rj^[lni-I + QI-zz+ E Ro,aMz''r 

^ |a+a|=4 

+ r;' E i?M,a(0)^'^"^" + O(r;') , (59) 

2|fc| + |a + a|-5 
|a+a|=3,5 

analytic on 

The Hamilton's equations of motion induced by the Hamiltonian (59) 

i = -d^H, <j) = diH, z = id^H, t = -id,H, (60) 

can be written as 

^ = E 9^K,a,M^''^-v' E d^RoM^f^)^"^ + 

|a+o|=3 |a+a|=4 
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21fc| + |ii + a|=5 

la+3|=3.5 



+ 



0, = u;i + ri^[{ni)i+ Yl Qj 

l<j<m 

2 1 fc I + I a + a| —5 
I a + Q^I — 3,5 

|a+a|=3 

|a+a|=4 



+ 



ir/' E Rk,a,am%z-^~'' + 0(77') , (61) 



2|fc| + |a+a|=5 
|a+a|=3,5 



for i = 1, . . . , n, J = 1, . . . , m. 

Critical points of the Hamiltonian action functional 



A{I{t),(t){t),z{t),z{t)) := r I ■,j) + izi- H{I{t),(f){t),z{t),z{t))dt, (62) 

JO 

in a suitable space of T-periodic functions, are T-periodic solutions of (60). 
4.1 The pseudo periodic solutions 

We will find periodic solutions of the Hamiltonian system (60) close to periodic solutions 
of the integrable Hamiltonian 

2 

Hint ■.= co-I + ^ni ■ I + Qzz + ri^QI ■ zz. (63) 

The manifold {2; = 0} is invariant for the Hamiltonian system generated by Hint^ 

/ = 0, 4) = uj + rf{ni +Q^zz), z = i{yt + 7fQI)z (64) 

and it is completely filled up by the invariant tori T(7o) '■— {I — Iq, £ T", z — Q}. On 
T{Iq) the flow is t {/q, </)o + (ciJ+?7^7^/o)t, 0} and in its normal space it is determined by 
z = iQri{Io)z where f2^(/o) is the m x m diagonal matrix with real coefficients associated 
to the vector of the "shifted elliptic frequencies" 

Qr,{Io):^^ + V^QIo , (65) 



^^We recall the usual notation for the vector Q'^zz G R" whose components are {Q^zz)i := 
J^jLi QjihzjZj, 1 <i<n and for the m x m diagonal matrix Q.+'q^QI := diag {^i+rf^{QI)\., . ■ ■ , + 
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For any Jq G R", ^n{Io) is a real matrix, since Q is real (see page 8). 
For suitable T > 0, /q € R"^, k e Z", namely when 

1 1 

a) := a; + 77^7^/o = ^SttA; e -27rZ", (66) 

the torus T(/o) is completely resonant, supporting the family of T-periodic motions 

V -.^ {l{t) ^ lo, (t>{t)^(t>o + ^t, z{t)^Q}. (67) 

The family V will not persist in its entirety for the complete Hamiltonian system (60). 
However, the non-resonance property (68) below, between the period T and the "shifted 
elliptic frequenies" Q^(/o), is sufficient to prove the persistence of at least n geometrically 
distinct T-periodic solutions of the Hamiltonian system (60), close to V. Precisely, the 
required non resonance property is 

M := M(Io,T) := 1^ - e'"''^-^")^ is invertible and \M-\lo,T)\ < const. (68) 

Our aim is then to find Iq and T so that (66) and (68) hold: we will define Iq := Io{T) in 
dependence on the "1-dimensional parameter" T in such a way that (66) is identically 
satisfied and then we will find T so that the non resonance property (68) holds. Moreover, 
for our perturbative arguments of Lemma 4.3, we want Iq — 0{1) and T < 2/r)^. 
Define, for T > 1/rf, 

;„ := /o(T) :^ -^n-^{^) . (69) 

where {{xi, . . . ,Xn)) '■= {{xi), ■ ■ ■ , (xn)) and the function (■) : R ^ ["1/2? 1/2) is defined 
as (x) := X for X E [—1/2, 1/2) and it is 1-periodically extended for a; e R. Notice that 
Iq e R" since 7?. is a reaZ matrix (see page 8). With the choice (69), (70), uT -\-rf'lZlQ{T) — 
2nk, and then (66) holds. In addition, for T > l/rf, Iq{T) = 0(1). Moreover 

O^T = nr,{Io{T))T = + ri'^QIoT = 2n (n^ - Qn-\uj^)^ . (71) 

In order to prove the non- resonance property (68), we note that 

^1 1 2 

'"^ ' ~ min le^^"^^ - 11 ~ min I sin(l]„,T)| " min dist(l]„,T, 27rZ) ' 

l<j<m i<j<m i<j<m 

Lemma 4.1 Suppose that condition (a) of Theorem 1.1 hold. Define, for m > 1, 



dn :— min 



1 1 



4 max I a j 1 1 4 max Mj 



5 :— min < 



do 1 



2 max \{QTZ ^),|i ' 4 max |aj|i 



(73) 
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where {QTZ is the j-row of the matrix QTZ ^, and, for tji — 0, 

do '■— - , S := min < r— — , - ^ . (74) 

4 8 max |(Q7^-^ i '4 ^ ' 

Let M := 1cm (Mi, ... , M^), for rh>l, and M = 1 for rh = 0. Finally let^'^ 

S do 




:= Te,r„ — , — , := min < 



4 max \uji\ '8 max 

l<i<n ' ' l<j<m' ■' ' 



(75) 



Then yto>0, there exists an interval J' G [to — 2tiQ, to + 27rTe + 2nQ] of length, at least 
47re, such that ej, M'^ := M-^{Io{T), T) satisfies 

\M~'\ < ^ . (76) 

Proof: In order to define the periods T we want to use Lemma 2.3. Let us verify that 
its hypothesis are fulfilled. If {uj,Q) are rationally independent, i.e. m = 0, we can apply 
it directly. If m = 1 we observe that (11) holds by definition, since Mj > 1 = m. 
If m = 1 = Ml we have also to show that (12) is satisfied. This is true: indeed, by 
contradiction, if (12) were false then Qi = Z^"=i auUJi violating the first order Melnikov 
condition (namely (4) with \h\ < 1). If m = 1 then m = 0, 1 and we are in one of the 
previous cases. We finally consider the case rh > 2. We have to prove (11). Note first 
that it is verified for m = 2. Indeed in this case m = 2 and, hence, a) = cj. By definition 
Mjflj = Qj ■ u for j = 1,2. Again by the first order Melnikov condition we have, for 
j — 1,2, that Mj > 2 which imphes Mj > 2 — rh and (11) holds. All the remanent cases 
are covered by the hypotesis (Hi). We can apply Lemma 2.3. 

Let to < T < to + Te he the time found in Lemma 2.3 and consider the interval 
J := 27rr + 27r[-0,0] C [to - 27re, to + 27rre + 27re]. V T = 27rT + 27r^ G J (i.e. |^| < 9) 
formula (71) becomes 

n^jT = 27r(%(T + 6)- {Qn-^)j{uj{T + 6))) V 1 < j < m. (77) 

By (13), VI < i < n there exists a fcj G Z such that cj^r = ki + {uJit) with |(u;jr)| < 5; 
moreover \ujid\ < 5/4 by definition of O. Hence we have \uJi{T + 9) — ki\ < 5 + 5 /A < 1/2 
being 5 < 1/4. So {ujiir + 9)) = ujiir + 9) - ki and 

\{ui{T + 9))\ <^8 , Vl<i<n. (78) 

For 1 < j < m, by (14) we have dist(f2jr, Z) > do, hence, by the definition of ©, 
dist(Qj(T + 9), Z) > do — do/^. Collecting the previous inequalities and (78), from (77) 
we obtain 

dist(f)^,T, 27rZ) = 27^distfe(T+^)-(Q7^-^),•(a;(T+^)),z) > 27r L - — - ^] =!!^ 

^ ^ Y 8 8 / 2 

by definition of 5. Finally, we recall (72) to end the proof. □ 
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The ergodization time T^^g was defined in (10). 
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Lemma 4.2 Let condition {b) of Theorem 1.1 hold, namely o; > 0. Let 

6:— min - — j- and di:=min|^^, 1. 

i<i<n \ujj\ "-Sm 2nm' 

ThenWto > there exists an open set A C [to,to + 4:Tr9] of measure, at least, irO/n, such 
that VT e A, M-^ := M-\Io{T),T) satisfies 

\M-'\ < |- . (79) 

Proof: The function T Qri{Io{T))T is a piecewise smooth function with discontinuities 
at the points Ti^k = + 1 < i < n, k E Z. Apart these points f2j,(/o(T))T 
is different iable w.r.t. to T and has constant derivative Q — QTZ~^uj =: ^ G R"^. By 
the definition of 9, in every interval of the type {2'K9{h - l/2),27r9{h + 1/2)), h e Z, 
fall at most n — 1 points of discontinuity and, hence, there exists an interval J'l C 
{2n9{h - l/2),2Tr9{h+ 1/2)) of length, at least, A := 27T9/n, in which Q^(7o(r))r is 
smooth. Hence, on Ji, by (71), 17^T = a; + for a suitable x e R"*. 
For 1 < j < m, let define the sets 



{T eJi s.t. dist(Q^jr,27rZ) > ^ } if |^j|A > tt 

TT}/ 



{T eJi s.t. dist(0^jr, 27rZ) > -^a } if \^j\A < n 



Remembering the definition a :— mini<j<m we note that meas(;Bj) > A(l — 

VI < i < m. Let A := Hf^iBj, then A Q Ji and meas(Ji) > A/2. By construction 

VT e ^ , dist(n^jr, 2nZ) > di , V 1 < j < m. Finally the Lemma follows from (72). □ 

Remcirk 4.1 Our non resonance conditions {a)-{b) of Theorem 1.1 are sharp: if {a)-{b) 
arc violated, it is not possible in general to find a period T is such a way that the matrix 
Ai defined in (68)-(71) is invertible (clearly it must be m > 3 and jfi > 1). As an 
example, consider the Hamiltonian ~ 

— 1 2 1 — —a 

OJ ■I* + Q,Z^ ■ + -\X^\ H ^(ajiZti + aj2Xf2)^*i^*j + ^ ^k,a,a{f*)-^*^*^*^ 

P j=l 2|fe| + |a+a|>6 



with m > 4 {m < m) and 



1 ifl<j<m — 1 — f j ifl<j<m — 1 

if J = m ' ■'^ ' \ 1 if J = m 



The Hamiltonian is in the form (l)-(5). We choose tji so that p := m — 1 is a prime 
integer with 3 < p < m — 1 (we require p 7^ 1, 2 since {uj, fl) must satisfy the second 
order Melnikov non-resonance conditions (4) and {00, fl) are related by (80) below). Let 
also (2; — {lu, flm+i, ■ ■ ■ , ^m) be any rationally independent vector in R** and define 

flj := -{ajiuii + 0^21-^2) , VI < J < rn . (80) 
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Note that, by (80), the equations (5) are fulfilled with Mj = p, VI < j < rh. Hence 
Mj = p = m — l<rh and condition (a) — {iii) is violated. After the rescaling in 
(26), the new Hamiltonian is H ^ UJ ■ I + VtZ -Z + ri^{\\I\^ + QI ■ Z'Z) + 0(77^) where 
Q e Mat(m x n, R) is defined by 



Since the Hamiltonian Ti docs not contain terms of the form (28)-(29)-(30)-(31), Ti is yet 
in the normal form (32) (i.e. (59)) with IZ = 1„. Therefore {fl — Q7l^^u)j = {Q— Qu)j — 
0, VI < j < m, by (80), and also condition (b) is violated. Now, whatever we choose 
T e R, /q G R", n G Z" such that u + rflZlQ = 2nn/T, i.e. (66) is satisfied, we get, 
substituing Jq = ri-^n-^{{2nn/T) - u) into (65), 0^(/o)T = {Q- Qu;)T + 2nQn. Hence, 
VI < J < m 



We claim that, for all G Z, at least one fi^jT is an integer multiple of 27r and hence 
the matrix M. :— Ij^ — e'^''^ has a zero eigenvalue. In fact. 



Thus, if n2 is a multiple of p, then Vt^^^T G 27rZ. Otherwise, let j* be the unique solution of 
the linear congruence n2j* = —ni modp (recall that p is prime). In this case flj^j*T G 27rZ. 
In both cases M is not invertible. 

In the next Lemma we prove the existence of suitable pseudo T-periodic solutions of 
the Hamiltonian system (61) close to the manifold V. Roughly, by the "twist condition" 
detTZ 7^ and the nonresonance property (68), the manifold V is "non-degenerate", 
i.e. the only T-periodic solutions of Hint, close to V, are the set V. This implies, by 
the Contraction Mapping Theorem, the existence of a manifold of pseudo T-periodic 
solutions C</>o) close to V, diffeomorphic to T". (^^ are solutions of (60) for all t G (0, T) 
and satisfy 4>{T) = 0(0) = 4>q, z{T) = z{0) but it may happen that /(T) 7^ 

Lemma 4.3 Assume that Condition (a) or (b) of Theorem 1.1 holds. Then, there exist 
?7o, Co, C > 0, such that: ^rj G (0, r^o]; there exist an open set A.,, C ;^+Co] of measure 
greater than I/Cq such that VT G Ar^ and V0o G T" there exists a unique function 



a„ := (7^„0^„,z^J G C([0,T], R" X X C"^) n C^((0, T), R" x T" x C"^), 





elsewhere . 



VL^jT = 0,„(/o)T = 2n{Qjini + Qj2^^2) • 




if 1 < j <p, 
if j = rh . 



smooth in (po, such that 



• (i) Q^{t) solves (60) for all t G (0,T); 

• (ii) C4>o satisfies ^^^(O) = 0<^o(^) = </'0; Hoi^) = HoiT); 

• (iii) supjg[o,T] (lUoit) - ^1 + IMt) - 00 - + \z^o{t)\) < Crr" . 
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where Iq :— Iq{T) is defined in (69) and cu :— uj{T) :— uj -\- rfTZlQ. 

Proof: In order to define tfie set C ^ + Cq] of "non-resonant" periods T, we use 
Lemmata 4.1 or 4.2 (according whether condition (a) or (6) of Theorem 1.1 holds) with 
to :— rj""^. VT e Ar, we look for a solution of (61) (i.e. (60)) of the form 

I^,{t) = Io + riJ{t), <j)^,{t) = cPo + lJjt + riij{t), z^,{t)=riw{t), (81) 

for suitable functions (J, ip, w) : [0,T] ^ x T" x C"* satisfying V(0) = i/^iT) = 
and w{0) = w{T). The condition ip{0) = is a "tranversality condition": we impose the 
"correction" {J,ip,w) to belong to a supplementary linear space to the tangent space of 
the unperturbed manifold V (see [BB] for a discussion of the different supplementary 
spaces). The functions (J, ip, w) must satisfy the system 

J = 0{r,^), (82) 
^^-rfnj = 0{rf), (83) 
w,-in^jWj = Iff Rl,a,a{'Po + ^t)ajw''llf-'^ +0{ri'), j = l,...,m (84) 

|a+a|=3 

where fi^ = f2j,(/o(T)) G Mat(m x m. R) is the real diagonal matrix defined in (65). 

In order to find {J,i(j,w) we use Lemmata 2.4 and 2.5. In connection with the 
notation of Lemma 2.5 we have here M — rfTZ and M. — Im — e'^''^. Let L denote 
the corresponding Green operator in (24) and P := P[J,iIj,w; ^q) the right hand side of 
(82), (83), (84). It is sufficient to find a fixed point (J, -0,^) e X, space defined in (23), 
of 

{.J,i,,w) = LiPiJ,'4,,w;^o)) . (85) 

If T is obtained in Lemma 4.1, resp. Lemma 4.2, we have, by (79), resp. (76), that 
< 2/di, resp. |A^"^| < 4/7rrfo. Moreover \M\ = 0{r)'^), je^^"] = Idiagje'^"^}! < m, 
T — 0{r}~'^) and, hence, from (25), we get the estimate on the Green operator \L\ < Crj"'^ 
for some C > 0. Moreover P(0; 0o) = 0{r]^). Then, for a constant C large enough we 
have Sq := Crj > 2|L(P(0))|. Finally, since sup^^ \DP\ = 0{if')^ for 77 small enough, we 
verify also (21). Applying Lemma 2.4 in the ball i?^,, wc prove the existence of a solution 
C</,o satisfying \ \C<i>a\ \ — ^-^d hence, by (81), we get the estimate {iii). 

Since C</.o £ X solves the integral system (85), C,<j>o{t) is actually for all t e (0,T) 
and solves (60). 

Finally, since the operator (/)o LP{J, i/j, w; 0o) is smooth, by the Implicit Function 
Theorem, we also deduce that the function 4>q ^ is . □ 

Remark 4.2 The terms (28), (29), (30), (31), that have been "averaged out" in Propo- 
sition 3.1, could not have been treated perturbatively in the previous Lemma. Indeed 
(28) (resp. (31)) would have given rise to a term 0(1) (resp. 0{Tf )) in (84); (29) to a 
term 0(77) in (82); and (30) to a term 0{rf) in (84). Roughly speaking, since the period 
T > l/rfi only terms of magnitude o{rf ) can be dealt as perturbations. 
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Remark 4.3 The invertibility of the twist matrix 71 has been used in two ways: to 
modulate the frequency cu yielding the existence of nearby resonant frequencies, see (66), 
and to imply that the manifold V is non-degenerate (together with the non-resonance 
property (68)). Weaker conditions could in principle be used (if the elliptic variables were 
absent think to [CZl]). However, in this case, when TZ is degenerate one is forced to study 
the higher order terms in the normal form of Proposition 3.1 making the perturbative 
analysis much more difficult. Moreover in the three body problem application we will 
prove that TZ is invertible, see Lemma 5.1. 

Reiricirk 4.4 When m = 0, namely in the case of maximal tori, the twist matrix TZ 
reduces simply to the matrix of the second derivatives of w.r.t. the action variables 
X*. This is not the case when m ^ 0. Consider the Hamiltonian Ti^, = flZ^Z^+ 
I^{Z^ + Z^)+ I^/n where (X*, (^*) e R x T, {Z^,Z^) e and Q > 0. The twist matrix 
in (7) turns out to be 7?. = although the second derivative of H* w.r.t. X* equals to 
2/Q 7^ 0. Heuristically, for lower dimensional elliptic tori, the twist matrix TZ takes into 
account, with the second addendum in the r.h.s. of (7), the interaction between the torus 
variables [X^,ip^) and the elliptic variables Z^. Finally observe that the symplectic map 
— I , ip^ = (J) + {z — z) / (if2), Z^ — z — I /VL (which can be found through the averaging 
procedure of section 3) transforms Ti into the isochronous Hamiltonian H — cul + D,zz. 

4.2 The variational principle 

We now define the "reduced Hamiltonian action functional" f : T" — > R as the Hamil- 
tonian action functional A evaluated on the pseudo T-periodic solutions C(/)o obtained in 
Lemma 4.3, namely 

S{(j)o) := A{Iif>o, 4)^01 ^4>oi'^<t>o) = ho - 4><f>o + i^flio • '^<f>o - H{I^o, (j)if>o, Zci>o,Zci>o) dt . (86) 

t/ 

By Lemma 4.3 the reduced action functional £ is smooth in (pQ. 

Critical points of f : T" — > R give rise to T-periodic solutions of the Hamiltonian 
system (60), according to the following Lemma: 

Lemma 4.4 c?^q£(0o) = hoi'^) ~ hoi^)- Hence, if (p* E T"' is a critical point of £, then 
C</,* {t) can he extended to a T-periodic solution of the Hamiltonian system (60) . 

Proof: Differentiating w.r.t. 0o in (86) we get 

rT . . ^ ^ 

d(l,o£{4>o) = / <9</,o/</,o ■ 000 + ho ■ '9</,o00o + ^d^oZ<j,oZcf,o + iz^Qd^oZ(i,Q 
J 

— diHd^^^l^^^ — S^if (9,^0 — dzHd^^z^^ — d^Hd^^^z^^^, dt 

= /0o(r)a0o00o(r) - /0o(O)a0o00o(O) + id4,^z^o{T)z^^{T) - id^^z^^{0)z^o{0), 

^^S{<f)o) e R since Im (i2;0o^<^o) dt = Re (2^00^00) dt = ^■^{z^o'z^'o) dt = 0. 
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by an integration by parts, and since C^ol^) satisfies the Hamilton's equations (60) in 
(0,T). Moreover, since V0o G T'', 0<^o(T) = 0<^o(O) = 0o and = ^00(0)' deriving 

w.r.t. 00, we get d^^(j)^^{T) = ^^^^^^(O) = and d^^z^^{T) = d^QZ^o{0). This imphes 
d^^£{(t>o) = /<^o(^) - -^00 (0)- Hence, if 0* e T" is a critical point of C<^*(T) = C<^*(0) 
and we deduce that C<^* {t) can be extended to a T-periodic solution of the Hamiltonian 
system (60). □ 

The following Lemma, which is a consequence of the autonomy of the Hamiltonian 
H, holds. 

Lemma 4.5 V0o e T" there exists ^(^o, ti) ^ R-" ^^^^ ^(0o, ry) = a; + 0(77^) such that 

V{4>o, V) ■ d^o£{4>o) = 0, V0O e T". (87) 

Proof: Since C.^^ = (/^g, 0<^o, z^g) satisfies the Hamiltonian system (60) in (0,7) and 
MT) = 0<^o(O) = 00, z^o{T) = ^<^o(0)> then 

i/(/^„(T), 00,2:^0(0), ^</.„(0)) = ff(/^o(O),0o,^</,„(O),^0„(O)). (88) 

By the mean value Theorem there exists in the segment between [I^^{T), /^^(O)] such 
that 

9,iJ(e0o,0o,;^0o(O),^^o(O)) ■ [h.{T) - hM] = 0. (89) 

Define V{4>o,ri) := diH{^^^^, (pQ, Z(i,Q{0),z^g{0)). By Lemma 4.4 and (89), formula (87) 
follows. Finally, since I^,{T) - Iq = /</,o(0) - h = 0{7f), z^^{Q) = 0{7f) and diH = uj+ 
rflZI^- rf0^zz-\- 0{rf), we deduce the estimate 1^(00, -q) 0{rf). □ 

Proof of Theorem 1.1: By Lemma 4.4 the absolute minimum (and maximum) 0* G T" 
gives rise to a T-periodic solution C,^* of (60). However one expects the existence of at 
least n geometrically distinct T-periodic solutions of (60), i.e. solutions not obtained one 
from each other simply by time-translations. 

In order find multiple geometrically distinct periodic solutions of (60) we restrict 
the reduced action function £ to the plane E := [uj]^ orthogonal to the periodic flow 
uj = {1/T)27rk with k G Z". The set Z" n£' is a lattice of E, (see for example Lemma 8.2 
of [BBB]) and hence S can be defined on the quotient space L := £;/(Z" n £;) ~ T"-^ 

A critical i)oiiit c?* of £^ : F ^ R is a critical point of £ : T" — > R. Indeed, since the 
tangent space T<^oF = [i^]"'", then 

d^,£{r) = A(0*)a; (90) 

for some Lagrange multiplier A(0*) G R. (90) and Lemma 4.5 imply that A(0*)(|a;p -|- 
0(77^)) = and so, for rj small, X{4>*) = 0. 

By the Lusternik-Schnirelman category theory, see for example [Am], since catF = 
catT"~^ = n, we can define the n min-max critical values ci < C2 < . . . < c„ for the 
reduced action functional £\r- Let cf)*, . . . , 0* G F be n corresponding critical points. If the 
critical levels q are all distinct, the T-periodic solutions C<j>*{'t) — {h, 4>i + ^t, 0) -|- 0{rf') 
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of (60) are geometrically distinct, since their actions A{C^*) = S{(f)*) = q arc different. 
On the other hand, if some min-max critical level c, coincide, then S\y possesses infinitely 
many critical points. However not all the corresponding T-periodic solutions of (60) are 
necessarily geometrically distinct, since two different critical points could belong to the 
same orbit. In any case, since one periodic solution can cross T at most a finite number 
of times, the existence of infinitely many geometrically distinct orbits of (60) follows^^. 

Finally, under the inverse transformation of $, defined in Proposition 3.1, ry-close to 
the identity and the inverse transformation of (26), we find the T-periodic solutions 
of Theorem 1.1 satisfying the estimates 

The statement on the minimal period descends from the following Proposition. □ 

Proposition 4.1 Let ((t) = {I(t), (pit), z(t)) be a T-periodic solution o/(61) with Cri~^ 
>T>Tq for some Tq large, independent ofrj. Then the minimal period Tmin of( satisfies 
Tmin> const tV(-+i). 

Proof: Since ( is T-pcriodic, 0(T) — 0(0) = 2'iTk for some k G Z". We claim that 
Tmin > T/g where g := gcd(A;i, . . . A;„). Indeed Tmin > T^in where T^j„ is the minimal 
period of (f){t). Moreover T^j„ = T/n for some integer n >1 and (piTmin) — 0(0) ~ 27rk 
for some /c e Z". It follows that kn = k and so n < g, proving the claim. 

By the second equation in (61) we also have 0(T) — 0(0) = uT + 0{r)^T) and then, 
letting k := k/g e Z", 27rgk = uT + 0{r{^T). We deduce that 

r„.„>^>^|*|-o(;^f)>^^|*l-o(^), (91) 

g \uj\ \'^\g |<^| I'^l 

since rfT < C. Let now choose /i G Z" \ {0} with \h\ < \k\ such that k ■ h = 0. 
Multiplying by h we get = 2TTgk-h — to ■ NT -\- 0{rfT\h\) ans so u-h — 0{rl^\h\). Using 
the diophantinity of u) assumed in (4), namely |a; • /i| > 7(1 + |/i|)~"^, V/i G Z", we obtain 
\hY+^ > const 7^-2 > const T. Hence \k\''+^ > > const T and |^| > const 

The proposition follows from (91) for T >Tq large enough. □ 

Remcirk 4.5 The periodic orbits Cr/ found in Theorem 1.1 are 0(77^) close to the torus T 
since Iq, defined in (69), satisfies Iq = 0(1). We could also try to find periodic solutions 
when e.g. Iq = 0(1/?]) and so T = 0{l/rj). However the terms 0(/*^) = 0{r]~^) would 
be more difficult to control. 



5 The planetary spatial three-body problem 

In this section we will prove the existence of periodic orbits of the planetary non pla- 
nar three body problem, with "small eccentricities" and "small mutual inclinations", 

^^Non-degenerate critical points of the Poincare-Melnikov primitive Jo (H — iJj„t)(/o, ?f'o + 

ujt,0) dt could be contimicd to solutions of (60). However, it is very difficult to compute this function, 
its critical points and check whether they are non-degenerate (if ever true). 
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accumulating onto two-dimensional elliptic invariant tori. We first discuss the classical 
Hamiltonian formulation of this problem which dates back to Delaunay and Poincare. 
For a detailed treatment see the Appendix of [BCV] . 

The three massive points ("bodies") Pq, Pi,P2, with masses mo, mi,m2, interact 
one each other through gravity (with constant of gravitation 1). Assume that the masses 
of the bodies satisfy, for some <k < 1, 

mi mo , s 

Ke<—, — <e<l. 92 
mo mo 

The number £ > is regarded as a small parameter: the point Pq represents "the star'' 
and the points Pi and P2 "the planets" . 

We now recall the classical definition of the "osculating ellipses" (at time to) of 
the two-body problems associated to the planets Pi (i = 1,2) and the star Pq. Let u^^'' 
and -u*^*-* denote the coordinates of the points Pq and Pi at time to and let u^'^^ and u^'^^ 
denote the respective velocities. The "osculating plane" is defined as the plane spanned 
by (u^^-u^^^) and («« --u^o) ) ; the "osculating eUipse" is defined as the Keplerian ellipse 
(lying on the osculating plane) defined by the Kepler solution, with initial data {u^^\u^^'^) 
and («(*) — m(°)), of the two-body problem (Po, Pi) obtained disregarding (for t > to) the 
third body Pj (j 7^ i). 

We assume that the eccentricities of such ellipses are small and that the intersection 
angle between the two planes containing the two osculating ellipses (usually referred as 
"mutual inclination") is also small. It is customary in celestial mechanics to denote the 
major semi-axes of such ellipses by Oj and their eccentricities by e^. Let 

^ , ^ rrii 1 



s yJmo{mo + mi) 

[k* is a dimensionless constant satisfying < k* < 1). Since we are interested in small 
eccentricities, collisions are avoided by requiring that the major semi-axes aj = aj(A*) : = 
(A*/fi;*)^, i = 1,2, are different, and different from zero. We, therefore, fix, once and for 
all, 

< Omin < Omax (93) 

and, from now on, we shall consider (attaching the index 1 to the "inner planet" ) values 
of A* in the set 

jC := {A* e R2 : Oinin < Oi < 02 < a^^} . (94) 



The following classical result follows from the Delaunay- Poincare theory, see [BCV] . 

Theorem (Delaunay- Poinceire) Fix Aq e C . There exists a symplectic set of varia- 
bles^'' 

(/o, cpo,Po, go) e X X R2 X R2 
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With symplectic form dio A dipo + dpo A dqo- 



30 



where Jq = A* G X and I G C G is a suitable two-dimensional open cube centered at 
Aq, such that the Hamiltonian of the spatial planetary three-body problem takes the form 

Hoih, (P0:P0: Qo) = ^o(-^o) + /o(-^0, <PO:PO: Qo) , (95) 



with 



—1 iQi ^ e ^ ml{mo + mi] 

fo := £/i(/o,Po, Qo) + £/2(/o, <PO:PO: ?o) , 

/i /i,o(/o) + j^mioMj + ql) + /i(/o,Po, ?o) , 

/ /2 c?(/?o = , sup l/il < const|(po, ?o)|^ ■ (96) 

7-2 

/i anc? /2 are real-analytic and uniformly hounded on^^ 

Vo := X T^^ X Dj^ G C , (97) 
where ao,so,po are suitable positive numbers. Moreover fi is even in (po,?o) O'^d 
inf Tlj{Io) > mi \Tlj{Io)\ > const > , 

inf fn2(/o) -ni(7o)) > inf |n2(/o) - ni(7o)| > const > 0. (98) 



We underline that the actions Jq are simply Jq = A* and we refer to [BCV]-Theorem 
1.1 for the complete expressions of the other Delaunay-Poincare variables {(po,Po, Qo)- 
We remark that the eccentricities are estimated as^^ 

Cx I {Po, qo) \<ei< 4| (po, qo)\ , i = 1,2 (99) 

for two suitable constants < c^ < Cj (depending only on I) . 

The Hamiltonian Tio in (95) describes a nearly-integrable, properly degenerate, sys- 
tem: the integrable Hamiltonian Hq depends only on the two action variables (/oi,/o2)- 
Such degeneracies are a typical feature of problems arising in celestial mechanics and the 
source of the main difficulties (the application of standard KAM theory for finding max- 
imal tori require the Hamiltonian to be non-degenerate). The frequency vector V/io(-^o) 
is independent of e, and then the conjugated angles (po may be regarded as "fast angles" 
and, in "first approximation" the Tio-motions are governed by the averaged Hamiltonian 
ho + ^fi- By (96), for any fixed Iq, {ipo e T^} x {po — qo — 0} is an elliptic invariant torus 

^^Dp C denotes the open complex ball of radius p centered at the origin. 
22See (1.5),(C.10),(C.15),(C.17) of [BCV]. 
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for the averaged Hamiltonian hQ+efi run by the hnear flow (po V^o + V(/io+^/i,o)(-^o) t. 
These are the quasi-periodic motions that will persist, for s small, and Iq in a nearly full 
(two-dimensional) measure set, as proved in [BCV], see also Theorem 5.2. 

In the next Proposition, through an appropiate averaging procedure. The Hamilto- 
nian (95) is casted into a suitable normal form. 

Proposition 5.1 Fix N G N"*". There exists a 0{y^)-close to the identity, real analytic, 
symplectic change of variables {J,i/j,z,l) G X T~ X D~ (Jo, (po,Po, Qo) G Po C 
transforming the Hamiltonian (95) into the real analytic Hamiltonian 

H{J, -0, ^) — he{J) + eQ,{J)zz + eg{J, z, z; e) + f{J, z, z; e) 

where :— ho + 0{e), 

r = const s = const, p = const , 

C/:={JgT : \h'o(J)-e\>ao ,y leZ"^ ,0<\e\<K} Cl, 
is a closed set and 



K 

It results that 
Moreover 



Q{N -I) , I ^ ^, 1 

log-, ao := 2sup |/iQ|rii = constv^log - 



So 



'-"0 



meas 



T\U) < const aQ = O (^\/e log . 
sup \g{J^z^'z)\ < const -I- l^iy , 



(100) 

(101) 
(102) 

(103) 

(104) 
(105) 



inf iljiJ) > inf |Oj(J)| > Xo > 0, 



j&u 



inf (VL2{J) - iliiJ)) > inf \n2{J) - ^i{J)\ > Xo > 0, 



JeuZ 



for some positive constant xo- 



(106) 



Proof: The Hamiltonian (100) has been deduced in [BCV] in the case N ~ 3 and 
on the smaller domain U' := {J E I \ |/?.o(J) • i\ > const (v^log^+^ (!/£))/(! + |/|^), 
\ll ETP'X {0}} C U ^ sec formula (2.22) of [BCV] and introduce the complex coordinates 
(170). Note also that the analyticity constant p = const is bigger than p = log~^(l/£) 
given in [BCV] . For the proof of the Proposition see the Appendix. □ 

The manifold {;2 = 0} is invariant under the Hamiltonian system generated by the 
integrable Hamiltonian ^£(J) -|- £(}{J)zz, 



j = 0, tp — djhe{J) + sdjfl{J)zz, z — iefl{J)z 



(107) 
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and it is completely filled up by the invariant elliptic tori T{Jq) := {J = Jq, ip E T^, 
z = 0}, supporting the linear flow t — >• (Jq, ipo + u!s{Jo)t,0} with torus frequency 
i-^eiJo) '■= d J he (Jo)- This family of 2-dimensional tori will not persist in its entirety for 
the complete Hamiltonian system generated by Ti 

j=-d^H, ij = djH, z = id^H, i = -id,H, (108) 

due to resonances among the oscillations. However, the persistence of a set of positive 
(2-dimensional) measure of perturbed elliptic invariant tori -those with diophantine fre- 
quency uJeiJo) - has been proved in [BCV], using the KAM Theorem of [P62]. 

In Theorem 0.2 we will prove the existence of an abundance of periodic solutions 
with larger and larger period accumulating on each perturbed elliptic torus, applying 
Theorem 1.1. For this aim, we will first reprove (Theorem 5.2) the existence of the [BCV]- 
clliptic tori, using the KAM Theorem of [Pol] and furnishing also the KAM-normal form 
describing the dynamics in its neighborhood (it will be of the form considered in (1)). 
Moreover, for proving that the hypothesys of Theorem 1.1 are satisfied, we also need 
precise informations on the form of the KAM-transformation bringing into the KAM 
normal form, see Theorem 5.1-(m). 

For the existence result of the elliptic invariant tori (Theorem 5.2) and their sur- 
rounding periodic orbits (Theorem 0.2) it is sufficient, and we will assume, N = 3. 

First of all we rewrite the Hamiltonian Ti. in (100) in a form suitable to apply the 
KAM Theorem of [Pol]. Introducing the coordinate y G R" around each torus T{Jq) in 
the usual way J = Jq + y, the Hamiltonian 7i can be developed as 

H{y, V', z, z; cu) := n{Jo + y,iP, z,z) ^ Af + P (109) 

where M := hs{Jo)+ K{Jo) ■ y+ 6n{Jo)zz and P = P{y, ip, z, z- Jo) = Pi + P2 + Pi + Pi 
with 

Pi he{J, + y)-K{Jo)-K{Jo)-y = 0{\y\''), 
P2 := e(n{Jo + y)-n{Jo))zz^O{e\y\\z\\z\), 

Pa eg{Jo + y,z,z)^0(e{\z\ + \z\f), 

P4 := e^f{Jo + y,x,z,z)^0{e^) . (110) 

By the non-isocronicity property det h'^{Jo) 7^ there is a one-to-one correspondence 
between the actions Jq e U C'R'^ and the torus frequency u :— uj{Jq) = h'^{Jo) G O C 
where 

0:^{u;^h',{Jo) : JoeU}. (Ill) 

By (104) we have 

meas {h'^{I) \0) < const ckq = 0(yelog (-)). (112) 
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The frequencies uo := uj{Jq) may be introduced as parameters: denoting Jo = Jq{uj) : = 
(/i^)~^(a;) its inverse function, the Hamiltonian (109) can be finally written in the form 

H{y, -0, z] u) := N{y, z, z] u) + P(y, -0, z, z] u) (113) 

where TV^/, z, z] ui) := e{uj) + uj ■ y + VL{uj)zz, e{uj) := he{JQ{uj)), VL{uj) := eCl^Jq^ui)) and 
the perturbation P{y,ip, z,z;u!) is obtained by the one in (109) just replacing Jq with 
Jo{uj) '■— {h'^)~^{uj). RecaUing (101) the Hamiltonian H in (113) is real analytic in 

{y, ^Ij, z, z; u) G U-^^ x T~ x D~ x C»|, with 6 := const y/e (114) 

(since uj Joi^) '■= (K)^^ analytic). 

iJ is in a suitable form to apply the KAM Theorem of [Pol] that we rewrite in the 
next subsection. 

5.1 A KAM Theorem for elliptic tori 

The KAM Theorem of [Pol] applies to Hamiltonians like 

H := H(y, ijj, z,z;u;) -.^ + P ^ e{u;) + u; ■ y + 0,{u;)zz + P{y, -0, z, z; u) 

where {y, V', z, z) e R"x T"x C"*x and to e R" is regarded as a parameter varying 
over a compact subset O C R". 

The functions P = P{y, ip, z, 1; uj) and Q(uj) arc real analytic on the complex domain 
Vf^s xOs where Vr^s '■= D^2 x TJ x and f, s, 5 are suitable positive constants. 

The size of the perturbation P is measured by the following norm. Taking the 
Fourier- Taylor expansions 

P{y,ij,z,z;uj)= J2 Pa,a,i{y^uj)z'^e^'-^=Y.P,{y,z,z;uj)e''-^, 
let define^^ 

\\\P\\\r,s,S ■■= E |MP£|r^,5el^l^ 

where MP^ := X]a,o>o \Pa,a,tiy)\z"'z°' and | • l^^^ denotes the sup-norm over the {y,z,z) e 
X D^^ and u & O^. The following Theorem follows from [Pol]. 

Theorem 5.1 (Poschel [Pol]) Fix t > n — 1. Suppose 

sup \d^n{uj)\ < M (115) 

for some < M < +oo, and that the non-resonance condition 

\n(uj) ■h\>a , V 1 < < 2, /i e Z", yueO, (116) 
^■^Thc relation with the usual Fourier norm (used in the Appendix) ||P||r,s,5 '■= X^^ez" l-P^ Ir.ae'^'* is 

\\\P\\\r/2,s,S < 2^"'\\P\\r,s,6 and \\\P\\\r,s,5 > 2^"'\\P\\r,s,6 ■ 
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is satisfied for some a > 0. Then, there exists a positive constant k :— k{s) such that, if 
P is sufficiently small, 

V := IllPlllr^^ < ^ af^ < — , (117) 
III 111'^'*''^ - M + 1 - 16 ' ^ ^ 

then: 

(i) there exist a normal form A/"* := e^ + u ■ + VL^{u})z^'z^, a Cantor set 0{a) C O 
on which 

+ >^^^^^ , V£eZ" , <2 , |£| + |/i|^0 , a;eO(a) , 

(118) 

and a transformation T : 1^-/2.5/2 x C^(<^) — ^ ^^r,s X real analytic and symplectic 
for each u and Whitney smooth in u, such that 

H^,^HoT^K + R, with R,:= ^ Rlaaii^M^tzl] (119) 

2|A;|+|a+a|>3 

(a) T has the following form (omitting the dependence on uj) 

y = y^ + Y{y^,ijj^,z*,z^) 

Z — ~h ^ ("0* •) ■2^* 7 ■^*) 

z — z* + Z{ip^, z*,z*) (120) 

where 

Y:^ YkaMy*<t, Z:= Zaa{^*Kzl (121) 

2|fc|+|a+a|<2 |a+a|<l 

and, denoting by \\ ■ ||* := s^Pxi^/2?/2 I ' I' 

ll^ll* ) ) ^11-2^11* ) ^11-2^11* ^ const — ; (122) 

s a 

(Hi) if M is sufficiently small, i.e., if 

M < 1/4 , (123) 

then 

meas(C \ 0{a)) = Oiad""-^) (124) 
where d is the exterior diameter of O. 
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By Theorem 5.1 the Hamihonian system generated by H possesses a family of 
n- dimensional elliptic invariant tori T := {{y,ip,z) = (F(0, t/^*, 0, 0), z{ip^, 0,0))} 
traveled with frequencies cu, for each frequency vector in the Cantor set Oa- The dynamics 
near each torus T is described by the normal form (119), which in turn coincide with 

(1)- 

Let us make some comments on Theorem 5.1. Point (i) is Theorem A of [Pol] (we 
have fixed the constant p in the statement of Theorem A as p := s/4). 

Concerning point (ii), formula (120) follows from Section 4 of [Pol] (see, in partic- 
ular, page 574 of [Pol]). Formula (122) follows from Section 7 of [Pol] (see in particular 
the last estimate on page 592). 

Point {in) follows from Theorem B of [Pol]. Indeed, from (115), (116) and (123) 
O is essentially non-resonant according to the definition at page 565 of [Pol]. For finite 
dimensional systems this reduces to verify only that O is non-resonant (see again page 
565 of [Pol]), namely 

mm\e-(jj + n{uj) ■ h\>a (125) 

for all < \h\ < 2 and i e JCh, the closed convex hull of the gradient set Qh '■= 
{d^{n{uj) -h) : cu e O}. Since, by (115) and \h\ < 2, JC^^ c 5^^, taking M < 1/4 
as in (123), the unique integer vector Z e /C/j is Z = 0. Hence condition (125) must be 
verified for ^ = only, and this is condition (116). 



5.2 Abundance of periodic solutions in the three-body problem 

In this section we prove the existence of periodic orbits accumulating on elliptic 2- 
dimensional tori of the three body-problem. 

First of all we show that the KAM-Theorem 5.1 applies to the Hamiltonian H in (113) 
reproving the existence of elliptic invariant tori in the spatial planetary three body 
problem as in [BCV]. We assume the frequency parameter uu e to vary over the 
compact subset O. 

By (114) and (101), the Hamiltonian H in (113) is real analytic on D^,s x 0$ :— 
Dl^ xT^xD^xOs for 

f := ^/c^ , s :— const , 5 := const\/e , (126) 

where Cq is a small constant which will be determined later on (we restrict the domain 
of H w.r.t. to the larger one defined in (114) because with the choice (126) the smallness 
KAM condition (117) is satisfied, see (131), (132)). 
Applying the KAM-Theorem 5.1, we get 

Theorem 5.2 Fix r > n — 1. For cq and e small enough, there exists a Cantor set 
0{e) gOgK{I), with 

meas(/i;(J) \ 0{e)) < const v^elog ^ , (127) 
^^B'^ C R" is the closed ball of radius R and center using the | • I2 norm. 
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such that, for any u — u}{Jq) e 0{e), there exists a symplectic trasformation 

of the form (120), transforming the three-body Hamiltonian H in (113) into the normal 
form :— H o ^ as in (119). Moreover 

consi" E 

|cu • £ + a(cu) • h\ > r— , V£ e Z'* , < 2 , |£| + 7^ , e 0{e) . (128) 

1 + 

In particular, the three-body problem Hamiltonian H possesses a family of 2- dimensional 
elliptic invariant tori traveled with frequencies uj. 

Proof: Recalling that Q(a;) := £Q(Jo(a;)), it is easy to see that sup^^g^^ |9a;Jl(a;)| < 
sCq := M for some positive constant Cq and condition (115) holds true. Moreover, for 
< e < l/(4Co), M < 1/4 and also condition (123) is satisfied. 
We claim that condition (116) holds, with 

a := Xo£, (129) 

namely, 

\n{uj) • /i| > a := xoe, VI <\h\<2, he Vu; e O. (130) 

Indeed Vcj G O, fl{Lj) = eQ{jQ) for some Jq G U. Moreover, by (106), it is easy to see 
that \^{Jo) ■ h\ > xo, VI < \h\ < 2, /i G Z^, Jq G f/ and the claim follows. 

It remains to check the smallness condition (117), i.e. V < sr'^, since k = 0(1) and 
a := Xo^- Note that, from (110) and (126), 

r < const(r^ -^er^ + er^ + e'') < const(f^ + e^). (131) 

Hence, by (131), in order to check condition (117), it is sufficient that 

+ £^ < const (132) 

Since f :— ^/c^, (132) holds true for cq and e small enough. By Theorem 5.1 the result 
follows. 

From (124), since d = 0(1) and a = 0{s), meas {0\0{£)) = 0(e). Moreover, since 
by (112), meas {h'^{1) \ 0) = 0{^/e\og{l/e)), the measure estimate (127) follows. □ 

For proving that each elliptic invariant torus found in Theorem 5.2 lies in the closure 
of periodic orbits of the three body problem, we will apply Theorem 1.1 to the normal 
form Hamiltonian := i7 o $ given in (119) (which has the form (1)) corresponding to 
the three body problem. 

The crucial hypothesys to verify in Theorem 1.1 is the non-degeneracy of the twist 
matrix TZ defined in (7). We have to evaluate, for 1 < i, i' < n = 2 and 1 < j < m — 2 
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Rl oe (^*) '^^^ computed as the i?*, o{ip*) and their calculation is omitted. Due to 
the special form (120)-(121) of the canonical transformation $, we have 

dy^, (// o $) = [{dyH) o $] dy^,y with dy^.v ^6, + ¥,^,0,0^ , (l34) 

from which 

9l,yjHo^) = [{d'^yH)o^dy^^,y]dy^,y (135) 

+ {dl^H)o^ d,^^z]dy^^y . (136) 

We are now able to prove that 

Lemma 5.1 For cq and e small enough, the twist matrix TZ of the planetary three body 
problem is invertible and |7^~^| = 0{1). 

Proof: We need to evaluate (135)-(136) for (y* 2;* , ) = (0,-0^,0,0) -k. By (120), 
(122), (131) and since ro := ^/coe and a := Xo it results 

|l/i(^)| = 1^(^)1 < const — < const = const < const e. (137) 

a e £ 

Moreover, by (122) and standard "Cauchy estimates" we have 

|9,.y(*)|, J|9,.y(*)|, |9,,Z(*)|, |9,,Z(*)| <const^ = 0(co), (138) 

(for the second estimate note that dzS^ is independent of y^ due to (121)). 

From (135)-(136) we deduce, using (137), (138) and since H = Hq^Jq + y) + 0(e), 
with /lo defined in (96), 

— 3k- / V \ —3k- 



K,,y.M^) = O«(co) + 0„(£) = 0«(co) if i^i', 
dl,y.M^l - Ott(^)+0„(£)=0«(crVi), 



where 0^{c) denotes a function of ip^ with sup-norm for ip^ e T5/2 smaller than a constant 
multiplied by c. It follows 

^2e,,0,o(V'*) = ^e,+e,,,0,o(V'*) = Oj(co) if i' 7^ i, i?e,,e,-,o(V'*) = ©^(Co/^Vs) . 

^^Cauchy estimates allow to bound n-derivatives of analytic functions on a set A in terms of their 
sup- norm on larger domains A c A' divided by dist(9j4, 9^4')". 
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Evaluating the Fourier coefficients of the above function we obtain 

—3k- 

RleiAOfi = ^(J^ + <^(C0) , ^e,+e,„0,0,0 = ^(co) , for i' ^ i (139) 

\K,e„oA , \K,o,eJ < const cf e-\'\-s/\ (140) 

Prom (128), \u; ■ e + Q^j{u;)\ > const e/{l+\i\^), Ml e Z" and then, from (140) the second 
addendum in definition of the twist matrix TZ introduced in (7) is 

^ f r>* p* I p* p* ^ 

0( J: l±^cls e-¥) = 0(4). (141) 

Finally (139) and (141) imply that the entries of the twist matrix TZ corresponding to 
the spatial three body-problem are 

—3k- 

= T^rHl + 0{co) + 0{cl) , 7^,,,. = 0(co) + 0{cl) for t' + i. (142) 

By (142), for cq small enough, the matrix TZ is invertible and |7?.~^| =0(1). □ 

We can finally prove the abundance of periodic solutions in the spatial planetary 
three body problem. 

Proof of Theorem 0.2: Since the number of elliptic variables 2; is m = 2 condition (a)- 
(i) of Theorem 1.1 holds. Moreover, by Lemma 5.1, the twist matrix TZ is invertible with 
|7^-l| = 0(1), and then we can apply Theorem 1.1, proving the existence of an abundance 
of periodic solutions of the three body problem. Theorem 0.2 is finally proved. □ 



6 Periodic orbits near resonant elliptic tori 

In this section we study the persistence, for £ > 0, of the circular decoupled periodic 
motions of the planets around the star, once suitable conditions on the period and the 

masses of the bodies are satisfied. 

Let consider Jq G X, T > and k — {ki, k2) G with gcd(A;i, k2) — 1, such that 

uj := /i'o(Jo) = -jr , (143) 

where ho is the integrable Hamiltonian defined in (96). The decoupled three-body prob- 
lem possesses the family of (circular) periodic solutions 

CvoW ■= (Jo, i^o + ojt, 0, 0), 

with minimal period T and parametrized by -00 G T^. 
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Since is properly degenerate the persistence of these motions for e > can not 
be established without further informations on the perturbation /q. For continuing some 
of these solutions we will exploit the normal form H defined in (100) (with = 4). 

First of all, through a Lyapunov- Schmidt reduction similar to the one of Lemma 
4.3, we obtain the existence of suitable pseudo-T-periodic solutions. 

Lemma 6.1 There exists Ci, £i > 0, such that, for allT > 0, k E 7? with gcd{ki, /C2) = 1, 
< £ < min 1^1, 3^}, Jq E U satisfying 00 := /io( Jo) = 27r/c/T, and V i/jq E T^, there 
exists a unique function 

C^o = (^^oV'vo^vo) e c°([o,r], r2 X X c^)nc\{o,T), x x c^), 

smooth in ipo, so that, \/t e (0,T), C?/'o(^) ^■^ ^ solution of the Hamiltonian system (108)^^ 
with V'Vo(O) = '0Vo(^) = V'o; ^Vo(O) = ^V'o(^) (^i^d 

sup |Cv>o(^) -C^o(^)l < cie^ , 
te[o,T] 



where Cv'o(^) •= (-^s) ipo+'-^t, 0, 0) and Jg = jQ+0{e) is the unique solution ofh'^{Je 



Proof: We first note that, since det /io(J) 7^ (see (95)-(96)), by the Imphcit Function 
Theorem, exists, is unique and is e-close to Jq G U . Moreover, for £1 small enough, 

e R2 n f/conste C f/~/4 (siuCC 7=0{^)). 

Define X and Y as in Lemma 2.5, with n = m = 2. Let also := £ri(Jj), M := 

djh^lJe) and := I2 — e'^^^'^^^'^. Notice that, if < £T < 1/ci is small enough (namely 
Ci is large enough), then is bounded by a constant (independent on e). 

We look for T-periodic solutions of the Hamiltonian system (108) of the form ( — 

CV0+ {J:^:Z,^) . Set 



V 



-e%f{-k) 

-d]K{J,) J + djh,{J, + J) - djKiJ,) + edMJ, + J)z ■ I- 
+ (edjg + s^djf){~k) 

:(Q{J, + J) - Q{J,)) ■ z + {ed^g + e^d^f) (^) 



where the star above denotes, for short, -k := (J^ + J, ■j/'q + ci;t + iIj,z,z). We note that 
P(0) = 0(£^) by (105). We want to apply Lemma 2.4. From (25) of Lemma 2.5 we 
find \L\ = 0{l/{cle'^)), hence 5^ := 2|L(P(0))| = 0{e'^/c\) and sup^^^^^^ \DP{x)\ < 
const (5o+£^)- Then, taking Ci big enough, we can apply Lemma 2.4 proving the existence 
and uniqueness of a G -Bpo so that 



(144) 



26 



For the Hamiltonian H defined in (100) with = 4. 
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Let Cv'o(^) Cv-o + Qo' means of (144) and (2.5), it follows that (^^ satisfies the 
Hamilton equations (108) in (0, T) and the boundary conditions '?/'^o(0) = ip^^{T) = ipQ, 
^ipoi^) — ^tpoi"^)- As usual, by the Implicit Function Theorem, tpQ — is smooth. □ 

Finally, critical points of the "reduced action functional" £ : — > R defined by 

rT . ^ 

^ (V'o) / Ji^o ■ V'V'o + i^Vo • - '^(Cvo) dt 

J 

give rise, arguing as in Lemma 4.4, to periodic solutions of (108). As in the proof of 
Theorem 1.1 (see page 28) we deduce the existence of at least two geometrically distinct 
periodic solutions of (108) (corresponding to the points of maximum and minimum 
i^Q of £). 

We can finally state the following result which, in particular, will imply Theorems 
0.3 and 0.4 : 

Theorem 6.1 There exists Ci, £i > 0, such that, for allT > 0, k E T? with gcd{ki, k^) — 
1; < £ < min|£i,^|, Jo E U satisfying uj :— h'Q(Jo) — 27rk/T, there exist at least 
two geometrically distinct T -periodic solutions = {J^±,ip^±, z^±) of the Hamiltonian 
system (108)^^ with 

sup|C±(i)-C±(t)| <Ci£^ , 
ten ° ° 

where C,^±{t) := (Jg, ipQ+ujt, 0, 0) and — JQ+0{e) is the unique solution ofh'^{Je) = oj 
= 2'Kk/T. Note that sup^g^.T] IC^±(^) - (^o, i^t+^t, 0, 0)| = 0{e). 

Remark 6.1 The condition < eT < 1/ci (for ci large enough) required in the The- 
orem is sharp. Indeed, for eT = 0(1) some further resonance phenomenon can appear, 
destroying any periodic solution: note that e^^^^Je)T _ -^^ could be degenerate. It is for 
reaching this estimate that we take N — A'm the Hamiltonian (100). 

We now show that Theorems 0.3 and 0.4 follow by Theorem 6.1. 

Consider Jq G X, T > 0, /c = (/ci, /C2) G with gcd(/ci, ^2) = 1, such that u) := Hq^Jq) = 
2'Kk/T, i.e. (143) holds. Under suitable restrictions on e and T we shall prove that Jq E U 
where U — U{e) C X is the domain defined in (102). 

First of all we claim that there exists a constant C2 > large enough such that 

£>e-^/^2 =^ co-e^O, yO<\i\<K (145) 

where K — K{e) — const log(l/£) is defined in (103). In fact, since gcd(/ci, k2) — 1, 

oo-e^O =^ k-e^O =^ £eZ(-k2,ki)^ Kl > 1^1- (146) 

Moreover 

\k\=T^-^^^^>cjT (147) 
^''For the Hamiltonian H defined in (100) with = 4. 
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where cj := (l/27r) minj^gj |/io( Jo)| > (note that /io(Jo) — {i^iJoi , i^2Jq2) and X 
is compact). 

Prom (146)-(147) and the hypothesis e > e''^/''^, we obtain that A; • £ = 0, £ 7^ 0, 
imply \l\ > ciT > cxC2 log(l/£). For C2 large enough, cxC2log{l/e) > K — const log(l/£), 
and we conclude that A; ■ £ 7^ for all < \£\ < K. The claim is proved. 

It follows that V < |£| < ir, k-i > 1 and hence \uj-e\ = 27r\k-i\T-^ > 2nT-^. More- 
over, if £log^(l/£) < cgT^^ then 2ttT-^ > 2tt ^Je/c's \og{l/e) > a = constV£log(l/£) 
(the constant a is defined in (103)) for a suitable C3 > large enough. 

We have proved that conditions e > e"^/'^^ ^^d £log^(l/£:) < CsT"^ imply Jq G U. 
In conclusion, defining the functions 

£(r) := min {e-^/"% {ciT)-\ £1} and £(r) := min {f(c3T-2), {ciT)-\ £1}, 

(148) 

where F is the inverse of G{e) := £log^(l/£) and Ci,£i are defined in Lemma 6.1, we 
have proved: 

Lemma 6.2 Let T > 0, k = (/ci,/c2) G Z"^, with gcd{ki,k2) = I, and Jq E 2 such that 
u := n'oiJo) = ^ holds. Then 

e{T) < £ < e{T) =^ Jo e U . (149) 

We can finally deduce Theorems 0.3 and 0.4. 

Proof of Theorem 0.3: It is a direct consequence of Lemma 6.2 and of Theorem 6.1 
taking e{T), e{T) as in (148) and Tq > as the last instant for which e{To) = £(^0) ■ ^ 

Proof of Theorem 0.4: Define 

T(£) :=min{c2logi ,^} and T(s) -minj-^^^^ ,-!-} 

with £1, C2, C3 defined above. Theorem 0.4 is a direct consequence of Lemma 6.2 and of 
Theorem 6.1. □ 



7 Appendix: Proof of Proposition 5.1 

We first recall the following Averaging Theorem, the proof of which can be found in 
[BCV]. We first introduce some notations. For r,p,s > and U C we denote the 
complex set Wr^p^s '■= U,. x T^ x D^. For a function / := f[I,(p,p,q) real analytic for 
{I,ip,p,q) G Wr^p^s we denote by ||/||r,p,s its "sup-Fourier" norm given by 

feez2 \{i,P,q)eUrxD*^ J 
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Proposition 7.1 (Averaging Theorem) LetHo := /io(/o) + /o(-^0; V^OiPoi Q'o) be a real- 
analytic Hamiltonian on W^r,p,s- Assume that there exist aQ,K > 0, satisfying Ks > 6, 
such that 

\h'Q{Io) ■ k\ > ao/2 , y k e {k e Z'^ : < \k\ < K} , V/q G Ur . (150) 
Assume, also, that, if d :— mm{rs, p^}, then 

\\M\r,,,s < ^ , (151) 

where c> 1 is a suitable (universal) constant. Then, there exists a real-analytic symplec- 
tic transformation 

* : (/', ip',p', q') e Wr/2,p/2,s/e ^ (/o, ^o,Po, go) = *(/', v',p', q') e Wr,p,s (152) 
and a real-analytic function go = gQ{I',p', q') such that 

n' -.^Hoo^ ^ho + go + f* , (153) 
and the following bounds hold^^: 

sup \go{l',p',q') - fo,o{l\p\<^)\ < 11/11.%,. , (154) 

||/*||r/2,p/2,s/6<e-^^/^ . (155) 

Furthermore, for each {I' , ip' , p' , q') e Wr/2,p/2,s/6, {Io,^o,Po,Qo) = {I' , ^' , p' , q') satis- 
fies 

s\Io-n r\^o-¥>'\, p\Po-p'\, pko-g'|<^^^^. (156) 

Let, now, Ho — ho -\- fo be as in (95). and U as in (102). The estimate (104) directly 
foUows by the definition of U. Next, let us choose the sets and the parameters involved 
in Proposition 7.1 as follows: 

K:=^^ — lllogi^ ao := 2sup\ho\rK , r = c^y/e < ao , s := So , p := po , 



So e X, 



°"0 



(157) 

where c* is a suitable large constant to be fixed later and cxo, so, Po were defined in (97). 
Moreover we better specify the definition of U in (102): 

t/:={jeX : |/io(J) •£! > ao ,V£ e ,0 < |£| < i^} C . 

The estimate (104) directly follows by the previous definition. Notice that, from these 
definitions, there follows (for e small enough) that 

/— \ Olod 2 /T r-o\ 

tto = const log - , a= const r , —— = const ec^ , (158) 

S CJ\. S 



^^/o,o denotes the 0-Fourier coefficient of fo, i.e., its (/^-average. 
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(clearly, in the last evaluation, "const" does not involve c^). 

Now, it is not difficult to check that, choosing c* big enough and letting e be small 
enough, assumptions (150) and (151) are met. In fact, observing that /o in (95)-(96) is 
such that 

||/o||r,p,s < const £ , 

(151) follows from last equality in (158), by choosing large enough. As for (150), 
observe that for any point in Iq e Ur there is a point Iq & U at distance less than r from 
it. Hence by the definitions of ckq and r and by Cauchy estimates^^, for any Iq e Ur and 

any < |A;| < K, 

\KiIo) ■ k\ > \hM) ■ k\ - \h',il*) - KiIo)\ \k\ 
> ao — sup |/iq| r K 

= ao/2 , 

which proves also (150). Thus, by Proposition 7.1, there exists a real analytic symplectic 
transformation 

* : (/', ip',p', q') e Pi := x T| x Z)| ^ (/q, <^o,Po, ?o) e Ur x x C Pq, 



such that 



\I — Io\ < const— = const- t 

ao log- 



|p' ~Vo\i l^z' — 9ol < const = const J , (159) 

ttoP log i 

and which casts the Hamiltonian Ji^ into 'H! -.— Hoo^ with 

n'{I',^',p',q') := h{I')+g{I',p',q')+Mr,ip',p',q') , (160) 
where (since, by (96), /o,o coincides with efi{I,p,q)) 



sup \gQ — ef\\ < const = const 



(/',p',g')6t/,/2xy,/2 aor log(l/£) 

||/*|| r/2,pAs/6 < const £6"^"/^ < const £^ . (161) 

Thus, setting qq —: eg, /* =: e^f, we see that H' can be rewritten as 

n' := hin+sgiI',P',q')+e''7{I',^',p',q'), 
9 = h{I',p',q') + :^^^7i{I',p',q') (162) 



"Cauchy estimates" allow to bound n-derivativcs of analytic functions on a set A in terms of their 
sup-norm on larger domains A' D A divided by dist {dA, dA')"-. 
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with / and fi real-analytic on Vi (compare (157)). 

We now look for elliptic equilibria of the Hamiltonian g in (162). Set 

G{l',p',q') := {d,,g{l',p',q'), d,,g{l',p',q')) . 

Recalling (162) and the definition of fi in (96), we see that, by (98), 

G{I', 0, 0) = and det 9(p/,g/)G(/', 0, 0) = 16(01112)^ > , V /' e t/^/a- 

Therefore, by the Implicit Function Theorem, we infer that, for any I' e Ur/2 and for e 
small enough, there exist real- analytic functions, so that 

/' e Ur/2 - {p'{r 

,^), Q{I',^)) £ -^const/logi ^ ) 

and 

d,,g{l',p\l',e),q'il',e)) = = d,,g{l',p'{I',e),q'{I'.e)) . (163) 

For e small enough, we can consider the following analytic symplcctic transformation, 
which leaves fixed the /'-variable and is 0(^^^)— close to the identity^°, 

$':(/, v', u') e Ur/2 X Tl/, X Dp/3 ^ (/', if', p\ q') G Ur/2 X T^/g X Dj/, , 

given by 

I' = 

ip' = ^Ij' +p'{J',e)drq'{J',e) + drq'{J',e)v' -drp'{J',e)u' , 

p' = v'+p'{J',e), 

q' = u' + q'{J',e). 

In view of (163), the new Hamiltonian Ti := 7i' o $' has the form 

n{J', v', u') = h{J') + eg{J', v', u') + e'^fiJ', v', u') , 

with / and g analytic in Ur/2 x T^y^ x Dp/3 and 

d,>,u'giJ', 0, 0) = d^>,,,g{I\p'{I', e), q'il', e)) ^ , V 7' e Ur/2 ■ 

Also, the eigenvalues of the symplectic quadratic part of g are given by ±iClj{J'), for 
j = 1,2, where 



flj e R and 1^2^ — Qj\ < const ^ _ ^ . (164) 



1 

log 



6 



has generating function J' ■ ip' + (v' + p'{J', e)j ■ (^q' - q'{J', e) j . 
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Thus, by a well known result by Weierstrass on the symplectic diagonalization of quadra- 
tic Hamiltonians, we can find an analytic transformation close to the identity 

$ : (J, e Ur/2 X X ^ {J\ij',v\u') G Ur/2 X T^/, X , 

SO that J' = J and the quadratic part of g becomes, simply, J2'j=i ^jiJ) Whence, 
the Hamiltonian 7i takes the form := 7i o with 

2 _ 
n{J, V, u) - J) + £ ^ CljiJ) («2 + ^;2) + eg{J, V, u) + J, ^J, V, u) , (165) 

where 

/i,(J) :=/io(^)+£^(J,0,0) , (166) 
g, /, f2j are real-analytic for {J,il>,v,u) in 

V2 := C/./2 X X Dj/, (167) 

and 

sup \g{J,v,u)\ < const\{v,u)f . (168) 

Because of (164), the non-degeneracy condition (98) implies (for e small enough) 

inf Cli > inf IfiJ > const > , 

inf - jli) > inf 1^2 - > const > . (169) 



/2 



Setting :— 2flj for j = 1,2, introducing complex coordinates 



V + iu V — iu / „ X 



and defining 



g{J,z,z) :^ g (^J,^^,^-^j and f{J,'ijj,z,z):^f(^J,ip,^^,^-^j, 
we obtain (100). Finally (101), (105), (106), follows from (157), (168), (169), respectively. 
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